-- Logs begin at Tue 2022-06-14 23:29:46 UTC, end at Wed 2022-06-15 01:07:28 UTC. -- Jun 15 00:21:14.805065 dv-cinder-845178-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 15 00:21:14.813752 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 00:21:14 2022] *** Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: nodename: dv-cinder-845178-5-iscsi Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: machine: x86_64 Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: clock source: unix Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: pcre jit disabled Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: detected number of CPU cores: 4 Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: current working directory: / Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: detected binary path: /usr/bin/uwsgi-core Jun 15 00:21:14.815760 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: your processes number limit is 47680 Jun 15 00:21:14.816431 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: your memory page size is 4096 bytes Jun 15 00:21:14.816431 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: detected max file descriptor number: 2048 Jun 15 00:21:14.816431 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: lock engine: pthread robust mutexes Jun 15 00:21:14.816431 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: thunder lock: enabled Jun 15 00:21:14.816431 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 15 00:21:14.816431 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 00:21:14.860331 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: Python main interpreter initialized at 0x5632ebeb49c0 Jun 15 00:21:14.860331 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: python threads support enabled Jun 15 00:21:14.860331 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: your server socket listen backlog is limited to 100 connections Jun 15 00:21:14.860331 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: your mercy for graceful operations on workers is 90 seconds Jun 15 00:21:14.860665 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 00:21:14.860734 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: *** Operational MODE: preforking *** Jun 15 00:21:14.861005 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: *** uWSGI is running in multiple interpreter mode *** Jun 15 00:21:14.861005 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: spawned uWSGI master process (pid: 80485) Jun 15 00:21:14.861197 dv-cinder-845178-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 15 00:21:14.862147 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: spawned uWSGI worker 1 (pid: 80497, cores: 1) Jun 15 00:21:14.862147 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: spawned uWSGI worker 2 (pid: 80498, cores: 1) Jun 15 00:21:14.862294 dv-cinder-845178-5-iscsi devstack@keystone.service[80485]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 00:21:20.372885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:21:20.372885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: from cryptography.utils import int_from_bytes Jun 15 00:21:20.373667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:21:20.373667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: from cryptography.utils import int_from_bytes Jun 15 00:21:20.380536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:21:20.380536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: from cryptography.utils import int_from_bytes Jun 15 00:21:20.380990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:21:20.380990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: from cryptography.utils import int_from_bytes Jun 15 00:21:20.424011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 00:21:20.424207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 00:21:20.424400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] command line args: [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 00:21:20.424680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 00:21:20.424857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ================================================================================ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 00:21:20.425116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] admin_token = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.425361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_dir = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.425548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.425730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] config_source = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.425909 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] debug = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.426116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.427024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.427210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.427465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.427972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.428215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.428395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_config_append = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.431560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 00:21:20.431759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 00:21:20.431991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] command line args: [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 00:21:20.432145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.432268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 00:21:20.432369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_dir = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.432454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ================================================================================ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 00:21:20.432575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.432693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] admin_token = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.432848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.432979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] config_dir = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] config_source = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] debug = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.433904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_config_append = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.434968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_dir = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.435998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.436157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.436246 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.436427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.436587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.436687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.436771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.436855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] publish_errors = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.436992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.437092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.437235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.437313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.437468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.437547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.437701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.437784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.437932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] standard_threads = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.438987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_journal = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.439159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_json = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.439335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_stderr = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.439413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.439512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] use_syslog = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.439589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] publish_errors = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.439744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.439822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.440019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.440100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.440203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.440282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.440450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.440528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.440685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.440763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.440919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] standard_threads = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.440996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.441146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.441225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.441382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.441466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.441543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.441654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.441744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_journal = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.441882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_json = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.441964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.442082 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_stderr = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.442165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.442250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] use_syslog = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.442411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.442490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:21:20.442649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.442734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.442900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.442978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.443139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.443217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.443387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.443466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.443636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.443720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.443876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.443981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.444147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.444238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.444384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.444512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.444623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.444728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.444864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.444972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.445110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.445221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.445349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.445451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.445601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.445715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.445827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.445953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.446069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.446166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.446266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.446363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.446505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.446707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.446815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.446919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.447897 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448272 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.448992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.449126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.449241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.449350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.449468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.449606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.449734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.449859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.449983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.450116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.450253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.450380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.450510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.450653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.450820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.450908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.450992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.451113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.451195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.451311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.451418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.451566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.451677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.451831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.451957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.452058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.452155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.452265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.452375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.452474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.452580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.452696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.452867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.453989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.454844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455321 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.455962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.456118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.456208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.456366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.456446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.456601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.456679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.456838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.456916 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.457070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.457151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.457305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.457384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.457551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.457629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.457806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.457888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458356 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.458998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.459077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.459239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.459330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.459472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.459549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.459708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.459793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.459963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.460060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.460213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.460293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.460451 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.460530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.460686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.460773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.460923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461623 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.461934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.462088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.462173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.462328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.462407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.462563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.462642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.462802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.462887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.463038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.463117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.463276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.463360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.463512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.463599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.463748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.463827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.464004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.464239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.464471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.464704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.464939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.465171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.465416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.465654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.465901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.466139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.466393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.466655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.466898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.467132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.external = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.467365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.467663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.467898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.468151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.password = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.468382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.token = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.468620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.468855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.549963 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.550263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.550529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.external = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.550789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.551119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.551406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.552231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.password = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.552484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] auth.token = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.552743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.552997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.553259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.553502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.553765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.554028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.554268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.554515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.554773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.555035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.555114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.555294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.555381 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.555540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.555641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.555792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.555939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.556060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.556195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.556321 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.556455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.556582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.556718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.556826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.556983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.557085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.557247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.557380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.557496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.557638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.557752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.557908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.557988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.558163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.558262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.558426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.558526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.558665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.558772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.558910 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.559034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.559163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.559330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.559409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.559589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.559676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.559859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.559966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.560137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.560216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.560398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.560476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.560638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.560722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.560881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.560960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.561126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.561205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.561375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.561460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.561612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.561691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.561863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.561941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.562106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.562192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.562346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.562424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.562588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.562667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.562841 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.562928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.563077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.563157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.563322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.563400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.563559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.563645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.563811 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.563890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.564070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.564150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.564309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.564400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.564545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.564625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.564794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.564877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.565030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.565117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.565275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.565354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.565530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.565609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.565779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.565870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.566015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.566092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.566258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.566336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.566494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.566583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.566734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.566812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.567002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.567088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.567251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.567338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.567494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.567573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.567742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.567821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568098 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.568974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.569054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.569207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.569286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.569445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.569525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.569693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.569771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.569929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570725 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.570968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.571124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.571201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.571369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.571448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.571610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.571698 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.571843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.571952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.572108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.572187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.572341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.572422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.572573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.572651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.572810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.572894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.573058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.573138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.573297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.573382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.573533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.573611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.573770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.573848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574725 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.574974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.575052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.575211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.575290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.575448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.575528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.575686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.575764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.575932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576883 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.576962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.577129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.577207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.577376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.577455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.577610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.577688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.577844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.577923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.578080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.578160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.578317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.578396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.578555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.578634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.578788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.578868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.579027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.579105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.579269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.579349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.579510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.579596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.579754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.579832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.580981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.581059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.581219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.581298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.581455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.581533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.581682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.581758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.581934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.582013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.582170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.582247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.582403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.582482 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.582669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.582754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.582914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.583001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.583151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.583229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.583389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.583468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.583629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.583714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.583875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.584935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.585099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.585186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.585338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.585418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.585575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.585653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.585806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.585892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.586060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.586139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.586302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.586380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.586549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.586636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.586789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.586868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.587029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.587108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.587266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] role.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.587352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.587513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.587592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] role.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.587741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.587819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.588014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.588108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.588262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.588341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.588512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.588590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.588760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.588845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.589008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.589087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.589253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.589451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.589530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.589696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.589776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.589953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.590040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.590199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.590278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.590452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.590531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.590699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.590778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.590933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.591020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.591191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.591359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.591439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.591600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.591679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.591853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.591974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.592131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.592211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.592371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.592450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.592621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.592700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.592858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.592937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.593113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.593192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.593352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.593431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.593592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.593671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.593824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.593902 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.594060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.594140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.594296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.594376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.594543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.594621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.594786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.594866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.595035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.595113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.595274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.595354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.595514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.595594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.595745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.595823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.596999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.597130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.597249 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.597382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.597504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.597626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.597751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.597857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.597970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.598104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.598716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.598927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.599016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.599202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.599290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.599437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.599515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.599687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.599765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.599946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600668 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600909 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.600989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.601151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.601239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.601401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.601481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.601627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.601704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.601876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.601956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.602115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.602194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.602352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.602431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.602592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.602671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.602832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.602911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.603063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.603142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.603303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.603380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.603539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.603626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.603700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 00:21:20.603772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.604035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.604275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.604521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.604754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.604997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.605233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:21:20.605405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 00:21:20.634480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.634652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.634881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.635184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.635418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.635647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.643377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.644304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.671633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.671862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.672111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.672338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.725661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.726408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.774031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.774325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.774911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.775150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.840649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.840870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.841990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.842166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.865065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.865297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.865442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.865590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.865724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.865872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.866004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.866137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.866277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.866408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.866539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.866670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.866801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.866801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.877207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.877817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.890198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.890363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.890587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.890678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.890809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.890894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.891028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.891112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.891244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.891327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.891456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.891539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.891722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.891960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80498) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:21:20.908941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.909148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 00:21:20.909594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.909680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.909806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 00:21:20.909910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 00:21:20.910096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.910311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.910393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.910515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 00:21:20.910606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.911373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.911461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.911637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.911892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.912168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.922166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.922431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.922695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.922971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.923053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.923266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.923531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.923809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.931191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.932201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.934481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.934754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.935027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.935301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.935484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.935576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.935761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.935843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.936080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.936164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.936344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.936436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.936610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.936691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.936872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.936957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.937131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.937213 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.937397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.937663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.937931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.938195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.963982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.965221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.965538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.965812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.966833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.967110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.971070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.971343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.971621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.972388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.972670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.972953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.979583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.979859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.980992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.981273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.984362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.984647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.984928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.985205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.985475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.985741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.985822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:20.986003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.986086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.986264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.986354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.986548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.986822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.987094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.987362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:20.987628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.006220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.006496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.006578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.006770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.011337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.011595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.015003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.015287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.015377 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.015572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.020965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.021268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.024675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.025026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.028329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.028706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.028852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.029077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.029249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.029405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.029539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.029685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.029826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.029964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.030108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.030390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.051188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.051501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.051771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.052063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.052918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.053220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.053532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.053797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.061432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.062384 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.064231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.064485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.064604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.064844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.068637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.068924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.069206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.069517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.069808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.070541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.071012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.071343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.071635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.071929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.084026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.084307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.084608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.084887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.085170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.085443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.085716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.086035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.086427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.086736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.087023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.087303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.087585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.087857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.103664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.105813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.106960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.109091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.110289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.111881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.112404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.113707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.114010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.114092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.114290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.115793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.116103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.116383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.121605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.123210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.123620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.125262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.126489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.126778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.127064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.127339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.128502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.128789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.129071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.129343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.137523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.137809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.138097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.139394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.139687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.139996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.146604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80498) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.146833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.147112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.147397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.147666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.147969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.148242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.148426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:21:21.148509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.148698 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.148881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.148963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.149154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.149236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.149426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.149506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.149694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.149783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.149985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.150067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.150247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.150326 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80498) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.150619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.150890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.151160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.151432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.151699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.151987 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:21:21.187881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5632ebeb49c0 pid: 80498 (default app) Jun 15 00:21:21.189440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5632ebeb49c0 pid: 80497 (default app) Jun 15 00:21:21.191277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffbea-ba85-4a2b-867b-33c7e199ff2b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.191576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffbea-ba85-4a2b-867b-33c7e199ff2b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.191856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffbea-ba85-4a2b-867b-33c7e199ff2b None None] PATH_INFO: `/v3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.196580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Jun 15 00:21:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:29.865144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b23e84-04f2-4913-9f92-3ede4ec7ba69 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:29.865693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b23e84-04f2-4913-9f92-3ede4ec7ba69 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:29.865693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b23e84-04f2-4913-9f92-3ede4ec7ba69 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:29.870002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:29.875192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:29.875609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:29.875747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:29.944135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: INFO dbcounter [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] Registered counter for database keystone Jun 15 00:21:29.965201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG oslo_db.sqlalchemy.engines [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:21:29.971334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writer thread running {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:21:30.146888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG passlib.handlers.bcrypt [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80498) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 00:21:30.147312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG passlib.handlers.bcrypt [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80498) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 00:21:30.200772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:30.202365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:30.324527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 15 00:21:30.462940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b23e84-04f2-4913-9f92-3ede4ec7ba69 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:30.532943 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: INFO dbcounter [None req-63b23e84-04f2-4913-9f92-3ede4ec7ba69 None None] Registered counter for database keystone Jun 15 00:21:30.552289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG oslo_db.sqlalchemy.engines [None req-63b23e84-04f2-4913-9f92-3ede4ec7ba69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:21:30.558457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writer thread running {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:21:30.677219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b23e84-04f2-4913-9f92-3ede4ec7ba69 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:30.681403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caf613-62f5-4f57-b719-d5a70c3c506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:30.682070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf613-62f5-4f57-b719-d5a70c3c506d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:30.682352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf613-62f5-4f57-b719-d5a70c3c506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:30.682628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caf613-62f5-4f57-b719-d5a70c3c506d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:30.690594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caf613-62f5-4f57-b719-d5a70c3c506d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:30.742739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING keystone.common.rbac_enforcer.enforcer [None req-11caf613-62f5-4f57-b719-d5a70c3c506d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 00:21:30.743082 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caf613-62f5-4f57-b719-d5a70c3c506d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:30.752832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Jun 15 00:21:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:21:30.759514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:30.773816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebda41-cf1d-458d-8c2d-0e7d4cac1714 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:30.778199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f93f-ac41-4943-98d9-6534f2c2079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:30.779316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f93f-ac41-4943-98d9-6534f2c2079f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:30.779600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f93f-ac41-4943-98d9-6534f2c2079f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:30.779877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f93f-ac41-4943-98d9-6534f2c2079f admin admin] PATH_INFO: `/v3/projects/ef6352e5d076419cbaba12161ca4f129` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:30.781387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f93f-ac41-4943-98d9-6534f2c2079f admin admin] RBAC: Authorizing `identity:get_project(project_id=ef6352e5d076419cbaba12161ca4f129)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:30.832222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5048f93f-ac41-4943-98d9-6534f2c2079f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 00:21:30.832568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f93f-ac41-4943-98d9-6534f2c2079f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:30.837200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Jun 15 00:21:30 2022] GET /identity/v3/projects/ef6352e5d076419cbaba12161ca4f129 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:32.898776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac82f-358b-472e-ab58-b1e8ac9ffa07 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.899300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac82f-358b-472e-ab58-b1e8ac9ffa07 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.899394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac82f-358b-472e-ab58-b1e8ac9ffa07 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.903410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:32.908700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817b2c-db6f-4298-b54e-5ca6ba2659ed None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.909071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817b2c-db6f-4298-b54e-5ca6ba2659ed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.909266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3817b2c-db6f-4298-b54e-5ca6ba2659ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.928661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d3817b2c-db6f-4298-b54e-5ca6ba2659ed None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:32.930198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d3817b2c-db6f-4298-b54e-5ca6ba2659ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:32.939176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 15 00:21:32.961647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ac82f-358b-472e-ab58-b1e8ac9ffa07 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.974235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ac82f-358b-472e-ab58-b1e8ac9ffa07 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.978426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a40d64-8f96-43e7-83b9-b3be68d502cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.979051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a40d64-8f96-43e7-83b9-b3be68d502cf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.979337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a40d64-8f96-43e7-83b9-b3be68d502cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.979616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a40d64-8f96-43e7-83b9-b3be68d502cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.987261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a40d64-8f96-43e7-83b9-b3be68d502cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:32.989048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a40d64-8f96-43e7-83b9-b3be68d502cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:32.997692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 00:21:33.002713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3817b2c-db6f-4298-b54e-5ca6ba2659ed None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.011869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3817b2c-db6f-4298-b54e-5ca6ba2659ed None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.023826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37c0b6-ebe8-4526-a691-984bbc8255f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.023826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c0b6-ebe8-4526-a691-984bbc8255f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.023826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c0b6-ebe8-4526-a691-984bbc8255f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.023826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c0b6-ebe8-4526-a691-984bbc8255f5 admin admin] PATH_INFO: `/v3/users/c25537e8f9b64e58ba6db076b2ad8db7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.024215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37c0b6-ebe8-4526-a691-984bbc8255f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=c25537e8f9b64e58ba6db076b2ad8db7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.024215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37c0b6-ebe8-4526-a691-984bbc8255f5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.024215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/users/c25537e8f9b64e58ba6db076b2ad8db7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:35.185680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9e39-60b3-4eb8-a2f3-0b45f762d373 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.186227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9e39-60b3-4eb8-a2f3-0b45f762d373 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.186227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c9e39-60b3-4eb8-a2f3-0b45f762d373 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.187585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:35.193868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491d60-2bbe-4ad1-8cd0-838bcbc6251c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.194365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491d60-2bbe-4ad1-8cd0-838bcbc6251c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.194449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491d60-2bbe-4ad1-8cd0-838bcbc6251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.212073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-de491d60-2bbe-4ad1-8cd0-838bcbc6251c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:35.213248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-de491d60-2bbe-4ad1-8cd0-838bcbc6251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:35.235164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c1f0-4b55-4f75-b929-7330a3d1cf2c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.235447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c1f0-4b55-4f75-b929-7330a3d1cf2c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.235722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c1f0-4b55-4f75-b929-7330a3d1cf2c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.237086 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:35.242549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.242837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.243116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.283731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG passlib.handlers.bcrypt [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80497) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 00:21:35.284176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG passlib.handlers.bcrypt [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80497) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 00:21:35.292070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:35.315449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de491d60-2bbe-4ad1-8cd0-838bcbc6251c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.330175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:35.331740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:35.338844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.417565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de491d60-2bbe-4ad1-8cd0-838bcbc6251c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.429105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:35.450885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.451477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e055c-4801-4ef6-ab7e-282eb7f41b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.452304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e055c-4801-4ef6-ab7e-282eb7f41b84 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.452588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e055c-4801-4ef6-ab7e-282eb7f41b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.452873 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e055c-4801-4ef6-ab7e-282eb7f41b84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.464539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e055c-4801-4ef6-ab7e-282eb7f41b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-315e055c-4801-4ef6-ab7e-282eb7f41b84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:35.476182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:35.477211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:35.478113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:35.484608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e055c-4801-4ef6-ab7e-282eb7f41b84 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.549277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58f0ae-e187-4f7f-a206-4ffe5634a93c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.552169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.565092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.582446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e055c-4801-4ef6-ab7e-282eb7f41b84 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.584677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32482537-70a9-48af-b67e-c2de6d429c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.585571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482537-70a9-48af-b67e-c2de6d429c11 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.585852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482537-70a9-48af-b67e-c2de6d429c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.586126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482537-70a9-48af-b67e-c2de6d429c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.616781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.617444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.617733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.618012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.618789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:35.619072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.623299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.635758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:35.641404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.653728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32482537-70a9-48af-b67e-c2de6d429c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.655236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32482537-70a9-48af-b67e-c2de6d429c11 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.745457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268115b-a249-47d6-a612-510510af89a3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.753611 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:21:35.760120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32482537-70a9-48af-b67e-c2de6d429c11 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.762803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.782242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754812d-0d0d-4646-9076-f2a6c2883fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.783112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754812d-0d0d-4646-9076-f2a6c2883fcf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.783403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754812d-0d0d-4646-9076-f2a6c2883fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.783680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754812d-0d0d-4646-9076-f2a6c2883fcf None admin] PATH_INFO: `/v3/users/c25537e8f9b64e58ba6db076b2ad8db7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.785002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754812d-0d0d-4646-9076-f2a6c2883fcf None admin] RBAC: Authorizing `identity:get_user(user_id=c25537e8f9b64e58ba6db076b2ad8db7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.786570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754812d-0d0d-4646-9076-f2a6c2883fcf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.788261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/users/c25537e8f9b64e58ba6db076b2ad8db7 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:35.793609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754812d-0d0d-4646-9076-f2a6c2883fcf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.807965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.858607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32482537-70a9-48af-b67e-c2de6d429c11 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.891009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754812d-0d0d-4646-9076-f2a6c2883fcf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.892505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.893298 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.893588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.893871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.911817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.913304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.923211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af9483-e442-44a9-9801-28609b31821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.924016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af9483-e442-44a9-9801-28609b31821b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.924302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af9483-e442-44a9-9801-28609b31821b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.924579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af9483-e442-44a9-9801-28609b31821b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.926325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af9483-e442-44a9-9801-28609b31821b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.927729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af9483-e442-44a9-9801-28609b31821b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.929352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:21:35.934520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:35.935403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:35.936231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:21:35.936231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:21:35.936231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:21:35.936231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:21:35.936428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af9483-e442-44a9-9801-28609b31821b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.936499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:35.941213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.996721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:36.014289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:36.032658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af9483-e442-44a9-9801-28609b31821b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:36.040575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744893b8-a5cc-48de-b153-ddcdb1f7ba31 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:36.066056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da619-6cfc-4250-a069-99941014adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:36.067333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da619-6cfc-4250-a069-99941014adda None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:36.067615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da619-6cfc-4250-a069-99941014adda None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:36.067889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da619-6cfc-4250-a069-99941014adda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:36.068740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da619-6cfc-4250-a069-99941014adda None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.domain.id=default, user.id=c25537e8f9b64e58ba6db076b2ad8db7) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:36.069049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da619-6cfc-4250-a069-99941014adda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:36.070464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da619-6cfc-4250-a069-99941014adda None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:36.074346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c42043-702b-4aae-86d0-2784125c5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:36.075011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42043-702b-4aae-86d0-2784125c5522 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:36.075300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42043-702b-4aae-86d0-2784125c5522 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:36.075581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42043-702b-4aae-86d0-2784125c5522 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:36.076334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c42043-702b-4aae-86d0-2784125c5522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:36.076645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c42043-702b-4aae-86d0-2784125c5522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:36.077023 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/role_assignments?user.id=c25537e8f9b64e58ba6db076b2ad8db7&scope.domain.id=default&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:36.078146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c42043-702b-4aae-86d0-2784125c5522 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:36.097445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:38.377770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af63f9-1efd-47e8-883f-7c4a5a4855c2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.378281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af63f9-1efd-47e8-883f-7c4a5a4855c2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.378353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af63f9-1efd-47e8-883f-7c4a5a4855c2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.379723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:38.385674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e7ab-5f0a-4f25-aa99-6dc3cf16ec19 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.386094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e7ab-5f0a-4f25-aa99-6dc3cf16ec19 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.386267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981e7ab-5f0a-4f25-aa99-6dc3cf16ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.414358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1981e7ab-5f0a-4f25-aa99-6dc3cf16ec19 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:38.415847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1981e7ab-5f0a-4f25-aa99-6dc3cf16ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:38.513004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:38.557602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af63f9-1efd-47e8-883f-7c4a5a4855c2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.610145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5327a03-ec39-429c-a4c7-caa2b59e279b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.610773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5327a03-ec39-429c-a4c7-caa2b59e279b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.611277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5327a03-ec39-429c-a4c7-caa2b59e279b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.612871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:38.618425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717a2a-d78b-4467-a7cc-044a2552d21f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.618950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717a2a-d78b-4467-a7cc-044a2552d21f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.619436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79717a2a-d78b-4467-a7cc-044a2552d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.649217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-79717a2a-d78b-4467-a7cc-044a2552d21f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:38.650817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-79717a2a-d78b-4467-a7cc-044a2552d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:38.749323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:38.750266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af63f9-1efd-47e8-883f-7c4a5a4855c2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:38.792075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:38.795000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308cb1-5833-4517-9bc3-dbfe852a80b0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.795292 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308cb1-5833-4517-9bc3-dbfe852a80b0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.795571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308cb1-5833-4517-9bc3-dbfe852a80b0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.796866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 14/26] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:38.802522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901410bc-711b-4684-83a8-6ac392ea0dea None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.802814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901410bc-711b-4684-83a8-6ac392ea0dea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.803096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901410bc-711b-4684-83a8-6ac392ea0dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.819347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce8c9-1d57-4ef4-9e74-8b1eb820baed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:38.820163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce8c9-1d57-4ef4-9e74-8b1eb820baed None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.820446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce8c9-1d57-4ef4-9e74-8b1eb820baed None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.820721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce8c9-1d57-4ef4-9e74-8b1eb820baed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.832859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-901410bc-711b-4684-83a8-6ac392ea0dea None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:38.834053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-901410bc-711b-4684-83a8-6ac392ea0dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:38.839394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ce8c9-1d57-4ef4-9e74-8b1eb820baed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ad2ce8c9-1d57-4ef4-9e74-8b1eb820baed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:38.847047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:38.847953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:38.848698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:38.851547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 13/27] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:38.852645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce8c9-1d57-4ef4-9e74-8b1eb820baed None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.857347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:38.977748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 15/28] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:38.978609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901410bc-711b-4684-83a8-6ac392ea0dea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.025450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce8c9-1d57-4ef4-9e74-8b1eb820baed None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.065248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.066932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.067465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.068015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.081734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.083623 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:21:39.106166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:39.107014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:39.107791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:21:39.107791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:21:39.107791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:21:39.107791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:39.110097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 14/29] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:39.111402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.163087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901410bc-711b-4684-83a8-6ac392ea0dea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.170621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.202009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.202681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.202963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.203238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.204006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:39.204313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.205696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.220016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 16/30] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:39.221046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.224383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.311346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ddcf-8ff1-4427-abfb-b79a331bc761 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.372324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38893f-8630-4d8f-8f61-5ea9a8d0561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.374149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38893f-8630-4d8f-8f61-5ea9a8d0561b None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.374453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38893f-8630-4d8f-8f61-5ea9a8d0561b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.374744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38893f-8630-4d8f-8f61-5ea9a8d0561b None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.375544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38893f-8630-4d8f-8f61-5ea9a8d0561b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.382276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38893f-8630-4d8f-8f61-5ea9a8d0561b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.417207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fec27-3c5f-49a7-824d-a88c7795860f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.454740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.455406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.455694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.456008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.456735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:39.457574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.458936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.476040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 17/31] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:39.476040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.513724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.592800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bc620-d91d-4c5f-b1c4-4e87cb8de9b2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.632765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc0277-544f-4342-aadc-01f36ddaa952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.634391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc0277-544f-4342-aadc-01f36ddaa952 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.634868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc0277-544f-4342-aadc-01f36ddaa952 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.635332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc0277-544f-4342-aadc-01f36ddaa952 None admin] PATH_INFO: `/v3/users/c25537e8f9b64e58ba6db076b2ad8db7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.637256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc0277-544f-4342-aadc-01f36ddaa952 None admin] RBAC: Authorizing `identity:get_user(user_id=c25537e8f9b64e58ba6db076b2ad8db7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.639038 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc0277-544f-4342-aadc-01f36ddaa952 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.646262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 18/32] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:39 2022] GET /identity/v3/users/c25537e8f9b64e58ba6db076b2ad8db7 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:39.648161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac37c24-e779-49a9-a827-f6a67bdb8357 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.648655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac37c24-e779-49a9-a827-f6a67bdb8357 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.649196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac37c24-e779-49a9-a827-f6a67bdb8357 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.651186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 19/33] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:39.656392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac37c24-e779-49a9-a827-f6a67bdb8357 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.711492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 15/34] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jun 15 00:21:39 2022] POST /identity/v3/roles => generated 219 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:39.712414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38893f-8630-4d8f-8f61-5ea9a8d0561b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.780321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac37c24-e779-49a9-a827-f6a67bdb8357 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.784355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.824637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8f03d-d4aa-41fe-a3d5-172ccddcfcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.825528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f03d-d4aa-41fe-a3d5-172ccddcfcda None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.825906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f03d-d4aa-41fe-a3d5-172ccddcfcda None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.826314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f03d-d4aa-41fe-a3d5-172ccddcfcda None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.827185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8f03d-d4aa-41fe-a3d5-172ccddcfcda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.829427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8f03d-d4aa-41fe-a3d5-172ccddcfcda None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.936035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38893f-8630-4d8f-8f61-5ea9a8d0561b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.955365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.984943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f109b7-5384-4de7-97db-db3ecca58664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.985756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f109b7-5384-4de7-97db-db3ecca58664 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.986040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f109b7-5384-4de7-97db-db3ecca58664 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.986319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f109b7-5384-4de7-97db-db3ecca58664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.987646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f109b7-5384-4de7-97db-db3ecca58664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.989364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f109b7-5384-4de7-97db-db3ecca58664 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.991474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 16/35] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:39.992904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70215bc-8660-48ca-841e-64f4bdf065f5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.993248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70215bc-8660-48ca-841e-64f4bdf065f5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.993529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70215bc-8660-48ca-841e-64f4bdf065f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.017852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c70215bc-8660-48ca-841e-64f4bdf065f5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:40.020363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c70215bc-8660-48ca-841e-64f4bdf065f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:40.104947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 17/36] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:40.105842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70215bc-8660-48ca-841e-64f4bdf065f5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.205531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 20/37] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:21:39 2022] POST /identity/v3/projects => generated 301 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:40.207476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c85b-fba1-470e-b5d8-bd4d82fa2d3e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.207775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c85b-fba1-470e-b5d8-bd4d82fa2d3e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.208382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805c85b-fba1-470e-b5d8-bd4d82fa2d3e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.209542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 21/38] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:40.210080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c85b-fba1-470e-b5d8-bd4d82fa2d3e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.235200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70215bc-8660-48ca-841e-64f4bdf065f5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.256484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:40.280569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c218c9-0b6b-48eb-8e8b-5bd030623b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.281446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c218c9-0b6b-48eb-8e8b-5bd030623b61 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.281733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c218c9-0b6b-48eb-8e8b-5bd030623b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.282014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c218c9-0b6b-48eb-8e8b-5bd030623b61 None admin] PATH_INFO: `/v3/domains/default/users/c25537e8f9b64e58ba6db076b2ad8db7/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.284444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c218c9-0b6b-48eb-8e8b-5bd030623b61 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c25537e8f9b64e58ba6db076b2ad8db7, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:40.286605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c218c9-0b6b-48eb-8e8b-5bd030623b61 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:40.333624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805c85b-fba1-470e-b5d8-bd4d82fa2d3e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.371767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 18/39] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Jun 15 00:21:40 2022] PUT /identity/v3/domains/default/users/c25537e8f9b64e58ba6db076b2ad8db7/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:40.372825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70a471-3a6b-4688-8719-0db14d78c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.373065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc82770-3595-4bab-8944-ab2e1a160d7f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.373292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc82770-3595-4bab-8944-ab2e1a160d7f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.373494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a471-3a6b-4688-8719-0db14d78c004 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.373603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc82770-3595-4bab-8944-ab2e1a160d7f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.373794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a471-3a6b-4688-8719-0db14d78c004 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.374102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70a471-3a6b-4688-8719-0db14d78c004 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.379127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 19/40] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:40.379321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70a471-3a6b-4688-8719-0db14d78c004 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:40.379466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32818df-2b48-4573-881d-92182c4ede74 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.379466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32818df-2b48-4573-881d-92182c4ede74 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.379628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70a471-3a6b-4688-8719-0db14d78c004 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:40.379712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32818df-2b48-4573-881d-92182c4ede74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.396476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d32818df-2b48-4573-881d-92182c4ede74 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:40.398201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d32818df-2b48-4573-881d-92182c4ede74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:40.443831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 22/41] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jun 15 00:21:40 2022] POST /identity/v3/roles => generated 225 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:40.445491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135e56-4b1b-4aeb-9d4f-b424843b62ec None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.445491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135e56-4b1b-4aeb-9d4f-b424843b62ec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.445799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135e56-4b1b-4aeb-9d4f-b424843b62ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.473449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b4135e56-4b1b-4aeb-9d4f-b424843b62ec None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:40.473449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b4135e56-4b1b-4aeb-9d4f-b424843b62ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:40.473449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:40.487112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 20/42] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:40.515248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32818df-2b48-4573-881d-92182c4ede74 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.563039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:40.584737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4135e56-4b1b-4aeb-9d4f-b424843b62ec None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.637943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32818df-2b48-4573-881d-92182c4ede74 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.640911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:40.686821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506c713-644d-4f41-8ce1-84655e37ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.687511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c713-644d-4f41-8ce1-84655e37ed14 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.687854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c713-644d-4f41-8ce1-84655e37ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.688232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506c713-644d-4f41-8ce1-84655e37ed14 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.689020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506c713-644d-4f41-8ce1-84655e37ed14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:40.690493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506c713-644d-4f41-8ce1-84655e37ed14 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:40.705387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4135e56-4b1b-4aeb-9d4f-b424843b62ec None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.746265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ccfb6-f6dc-45a6-9028-fccccf624981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.747087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ccfb6-f6dc-45a6-9028-fccccf624981 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.749408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ccfb6-f6dc-45a6-9028-fccccf624981 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.749408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ccfb6-f6dc-45a6-9028-fccccf624981 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.749408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ccfb6-f6dc-45a6-9028-fccccf624981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:40.750266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ccfb6-f6dc-45a6-9028-fccccf624981 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:40.751871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 24/44] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:40.757739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ccfb6-f6dc-45a6-9028-fccccf624981 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.766841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:40.773679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 21/45] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jun 15 00:21:40 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:21:40.871256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ccfb6-f6dc-45a6-9028-fccccf624981 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.908336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ab79b-a147-4014-af45-bd84f8a77ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.909011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab79b-a147-4014-af45-bd84f8a77ccd None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.909296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab79b-a147-4014-af45-bd84f8a77ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.909576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab79b-a147-4014-af45-bd84f8a77ccd None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.910335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ab79b-a147-4014-af45-bd84f8a77ccd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:40.911811 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ab79b-a147-4014-af45-bd84f8a77ccd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:41.003018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 25/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:21:40 2022] POST /identity/v3/projects => generated 312 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:21:42.550785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7c40-5cd2-4963-a57f-eda1163b3382 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.551297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7c40-5cd2-4963-a57f-eda1163b3382 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.551378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7c40-5cd2-4963-a57f-eda1163b3382 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.552894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 22/47] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:42.557730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fff2b-a059-4014-b544-531cac25de9b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.558149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fff2b-a059-4014-b544-531cac25de9b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.558299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fff2b-a059-4014-b544-531cac25de9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.575391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b68fff2b-a059-4014-b544-531cac25de9b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:42.576588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b68fff2b-a059-4014-b544-531cac25de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:42.628022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:42.641240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 26/48] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:42.664713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7c40-5cd2-4963-a57f-eda1163b3382 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.763546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7c40-5cd2-4963-a57f-eda1163b3382 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.796507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2e70-cb79-4312-8fbe-6a45d5eca133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.797287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2e70-cb79-4312-8fbe-6a45d5eca133 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.797570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2e70-cb79-4312-8fbe-6a45d5eca133 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.797849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2e70-cb79-4312-8fbe-6a45d5eca133 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.807606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e2e70-cb79-4312-8fbe-6a45d5eca133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b19e2e70-cb79-4312-8fbe-6a45d5eca133 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:42.815057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:42.816547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:42.817606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 23/49] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:42.822519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fff2b-a059-4014-b544-531cac25de9b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.917915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fff2b-a059-4014-b544-531cac25de9b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.952050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.952805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.953097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.953380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.954129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:42.954440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:42.955798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:42.964619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 27/50] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:42.970080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2e70-cb79-4312-8fbe-6a45d5eca133 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.995092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:43.071216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2e70-cb79-4312-8fbe-6a45d5eca133 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:43.107223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c7843-e80e-4f0d-b309-af0fa1a6dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:43.108126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7843-e80e-4f0d-b309-af0fa1a6dcde None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:43.108442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7843-e80e-4f0d-b309-af0fa1a6dcde None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:43.108722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c7843-e80e-4f0d-b309-af0fa1a6dcde None admin] PATH_INFO: `/v3/users/c25537e8f9b64e58ba6db076b2ad8db7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:43.109917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c7843-e80e-4f0d-b309-af0fa1a6dcde None admin] RBAC: Authorizing `identity:get_user(user_id=c25537e8f9b64e58ba6db076b2ad8db7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:43.111372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c7843-e80e-4f0d-b309-af0fa1a6dcde None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:43.113044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 24/51] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:42 2022] GET /identity/v3/users/c25537e8f9b64e58ba6db076b2ad8db7 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:43.118403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:43.135350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f2c47-bca3-41c7-892b-61ea529e0cbd None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:43.135712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f2c47-bca3-41c7-892b-61ea529e0cbd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:43.136032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f2c47-bca3-41c7-892b-61ea529e0cbd None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:43.137394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 25/52] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:43.142261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7122ec-d58b-474d-832d-feda15ae0ed9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:43.142558 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7122ec-d58b-474d-832d-feda15ae0ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:43.142846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7122ec-d58b-474d-832d-feda15ae0ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:43.160178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7e7122ec-d58b-474d-832d-feda15ae0ed9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:43.161375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7e7122ec-d58b-474d-832d-feda15ae0ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:43.169189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:43.219964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602611ea-2b68-46fd-be00-2aafdf902eea None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:43.227249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 26/53] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:43.250858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7122ec-d58b-474d-832d-feda15ae0ed9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:43.252990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f390a-a24c-4584-8717-472df37979e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:43.254359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f390a-a24c-4584-8717-472df37979e9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:43.254647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f390a-a24c-4584-8717-472df37979e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:43.254925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f390a-a24c-4584-8717-472df37979e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:43.256124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f390a-a24c-4584-8717-472df37979e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:43.257564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f390a-a24c-4584-8717-472df37979e9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:43.259436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 28/54] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:43.264919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f390a-a24c-4584-8717-472df37979e9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:43.275060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:43.350327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7122ec-d58b-474d-832d-feda15ae0ed9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:43.365529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f390a-a24c-4584-8717-472df37979e9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:43.382070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:43.383175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eaa371-9a66-4eee-a00f-b4ccbd1ec7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:43.384241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaa371-9a66-4eee-a00f-b4ccbd1ec7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:43.384529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaa371-9a66-4eee-a00f-b4ccbd1ec7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:43.384804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaa371-9a66-4eee-a00f-b4ccbd1ec7e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:43.385977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eaa371-9a66-4eee-a00f-b4ccbd1ec7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:43.387438 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eaa371-9a66-4eee-a00f-b4ccbd1ec7e6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:43.389077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:43.395051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eaa371-9a66-4eee-a00f-b4ccbd1ec7e6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:43.399199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd85ab0-e70b-48df-bf20-ed24964065d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:43.399859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85ab0-e70b-48df-bf20-ed24964065d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:43.400177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85ab0-e70b-48df-bf20-ed24964065d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:43.400461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd85ab0-e70b-48df-bf20-ed24964065d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:43.401297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd85ab0-e70b-48df-bf20-ed24964065d2 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.domain.id=default, user.id=c25537e8f9b64e58ba6db076b2ad8db7) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:43.401615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd85ab0-e70b-48df-bf20-ed24964065d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:43.403057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd85ab0-e70b-48df-bf20-ed24964065d2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:43.412932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 29/56] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Jun 15 00:21:43 2022] GET /identity/v3/role_assignments?user.id=c25537e8f9b64e58ba6db076b2ad8db7&scope.domain.id=default&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:43.489592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:43.499367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eaa371-9a66-4eee-a00f-b4ccbd1ec7e6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:43.536734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0eaeb-1afc-4725-be29-36eb3a3737aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:43.537416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0eaeb-1afc-4725-be29-36eb3a3737aa None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:43.537705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0eaeb-1afc-4725-be29-36eb3a3737aa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:43.537987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0eaeb-1afc-4725-be29-36eb3a3737aa None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:43.538711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0eaeb-1afc-4725-be29-36eb3a3737aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:43.540222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0eaeb-1afc-4725-be29-36eb3a3737aa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:43.627888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 28/57] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Jun 15 00:21:43 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:21:45.714644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c1d1-c2f5-4566-8391-d1686c0a84c4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.715155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c1d1-c2f5-4566-8391-d1686c0a84c4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.715235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31c1d1-c2f5-4566-8391-d1686c0a84c4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.716594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 30/58] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:45.721685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db0d6-216e-4522-846c-a43141681be2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.722095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db0d6-216e-4522-846c-a43141681be2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.722278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db0d6-216e-4522-846c-a43141681be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.739501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-404db0d6-216e-4522-846c-a43141681be2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:45.740722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-404db0d6-216e-4522-846c-a43141681be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:45.804165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:45.828348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c1d1-c2f5-4566-8391-d1686c0a84c4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:45.924418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31c1d1-c2f5-4566-8391-d1686c0a84c4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:45.956208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b299ee-0410-406c-8708-821a965f30ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:45.957001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b299ee-0410-406c-8708-821a965f30ba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.957284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b299ee-0410-406c-8708-821a965f30ba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.957555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b299ee-0410-406c-8708-821a965f30ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.958707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b299ee-0410-406c-8708-821a965f30ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:45.960150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b299ee-0410-406c-8708-821a965f30ba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:45.961703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 31/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:45.966975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404db0d6-216e-4522-846c-a43141681be2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.033645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:46.062119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404db0d6-216e-4522-846c-a43141681be2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.095330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d959e5-47c2-4d01-ac02-159f0562a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.096020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d959e5-47c2-4d01-ac02-159f0562a27c None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.096311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d959e5-47c2-4d01-ac02-159f0562a27c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.096593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d959e5-47c2-4d01-ac02-159f0562a27c None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.097811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d959e5-47c2-4d01-ac02-159f0562a27c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.099251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d959e5-47c2-4d01-ac02-159f0562a27c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.191753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 30/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:45 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:49.353288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e2d7a-f276-4094-994c-6720211ff0a6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.354378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e2d7a-f276-4094-994c-6720211ff0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.354880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e2d7a-f276-4094-994c-6720211ff0a6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.356503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 32/62] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:49.369574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3440-3481-43f6-918d-785e8ccc48cb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.370048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3440-3481-43f6-918d-785e8ccc48cb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.370218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3440-3481-43f6-918d-785e8ccc48cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.392428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f9bb3440-3481-43f6-918d-785e8ccc48cb None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:49.393356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca178b-f15f-4e45-b66b-38bd1cd821a1 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f9bb3440-3481-43f6-918d-785e8ccc48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:49.394494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca178b-f15f-4e45-b66b-38bd1cd821a1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.394887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca178b-f15f-4e45-b66b-38bd1cd821a1 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.396666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 33/63] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:49.407722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10655ef-d5f0-4d7c-832b-eaa5896a0188 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.408307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10655ef-d5f0-4d7c-832b-eaa5896a0188 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.408796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10655ef-d5f0-4d7c-832b-eaa5896a0188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.440937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b10655ef-d5f0-4d7c-832b-eaa5896a0188 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:49.442502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b10655ef-d5f0-4d7c-832b-eaa5896a0188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:49.472827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 31/64] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:49.498113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3440-3481-43f6-918d-785e8ccc48cb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:49.552295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:49.564510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:49.605745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 34/65] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:49.614867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3440-3481-43f6-918d-785e8ccc48cb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:49.667056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d17c84-7ba6-4212-bbf5-f561624d2441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:49.667862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17c84-7ba6-4212-bbf5-f561624d2441 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.668172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17c84-7ba6-4212-bbf5-f561624d2441 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.668451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17c84-7ba6-4212-bbf5-f561624d2441 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.671475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10655ef-d5f0-4d7c-832b-eaa5896a0188 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:49.682791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d17c84-7ba6-4212-bbf5-f561624d2441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a4d17c84-7ba6-4212-bbf5-f561624d2441 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:49.691981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:49.692913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:49.693679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 32/66] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:49.699948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d17c84-7ba6-4212-bbf5-f561624d2441 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:49.824728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d17c84-7ba6-4212-bbf5-f561624d2441 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:49.834935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10655ef-d5f0-4d7c-832b-eaa5896a0188 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:49.842984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:49.860924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edae1f-3b63-4e35-9654-641880b11eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:49.861819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edae1f-3b63-4e35-9654-641880b11eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.862251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edae1f-3b63-4e35-9654-641880b11eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.862698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edae1f-3b63-4e35-9654-641880b11eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.863595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edae1f-3b63-4e35-9654-641880b11eb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:49.864148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edae1f-3b63-4e35-9654-641880b11eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:49.865691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edae1f-3b63-4e35-9654-641880b11eb5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:49.876844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deccb7-e5be-46b5-9d5e-7107b5466147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:49.877840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deccb7-e5be-46b5-9d5e-7107b5466147 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.878789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deccb7-e5be-46b5-9d5e-7107b5466147 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.879227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deccb7-e5be-46b5-9d5e-7107b5466147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.880010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 33/67] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:49.881483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a208aaa-9f62-4556-bed5-51325d17da80 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.881964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a208aaa-9f62-4556-bed5-51325d17da80 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.882384 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a208aaa-9f62-4556-bed5-51325d17da80 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.884087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 34/68] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:49.886762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a208aaa-9f62-4556-bed5-51325d17da80 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:49.892997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deccb7-e5be-46b5-9d5e-7107b5466147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-39deccb7-e5be-46b5-9d5e-7107b5466147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:49.904762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:49.905795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:21:49.906737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:49.907622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98e5aa-4719-4b93-9a3a-862401bd1dc8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.907622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98e5aa-4719-4b93-9a3a-862401bd1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.907757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98e5aa-4719-4b93-9a3a-862401bd1dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.926842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3b98e5aa-4719-4b93-9a3a-862401bd1dc8 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:49.928585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b98e5aa-4719-4b93-9a3a-862401bd1dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:49.970358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.007574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 36/70] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:50.008709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98e5aa-4719-4b93-9a3a-862401bd1dc8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.023610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a208aaa-9f62-4556-bed5-51325d17da80 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.060232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ef38-e155-4240-b3f8-2912244d39a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.061130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef38-e155-4240-b3f8-2912244d39a2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.061415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef38-e155-4240-b3f8-2912244d39a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.061690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ef38-e155-4240-b3f8-2912244d39a2 None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.077578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ef38-e155-4240-b3f8-2912244d39a2 None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.079071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ef38-e155-4240-b3f8-2912244d39a2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.085261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:49 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:50.085261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063a023-55ee-4051-9e6c-2bab57d5d7e9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.085261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063a023-55ee-4051-9e6c-2bab57d5d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.085261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063a023-55ee-4051-9e6c-2bab57d5d7e9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.085261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 36/72] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:50.085261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063a023-55ee-4051-9e6c-2bab57d5d7e9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.129545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98e5aa-4719-4b93-9a3a-862401bd1dc8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.131387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.163149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.163926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.164275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.164560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.165310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:50.165621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.167028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.176024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:50.176815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.193490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063a023-55ee-4051-9e6c-2bab57d5d7e9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.207089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.230022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423d1ed-fe65-4f61-90a6-fc8102281032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.230955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d1ed-fe65-4f61-90a6-fc8102281032 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.231245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d1ed-fe65-4f61-90a6-fc8102281032 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.231525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423d1ed-fe65-4f61-90a6-fc8102281032 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.242167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423d1ed-fe65-4f61-90a6-fc8102281032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2423d1ed-fe65-4f61-90a6-fc8102281032 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:50.250222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:50.251220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:50.252056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 37/74] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:50.252703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f2aed-96f7-48ac-b229-f31cd0f4b0eb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.252875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f2aed-96f7-48ac-b229-f31cd0f4b0eb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.253160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f2aed-96f7-48ac-b229-f31cd0f4b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.269802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-590f2aed-96f7-48ac-b229-f31cd0f4b0eb None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:50.271000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-590f2aed-96f7-48ac-b229-f31cd0f4b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:50.277745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8bcd-73f0-420e-983c-09413c8423a8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.310778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e86c5e-2f46-4384-b53b-2f192676a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.311419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86c5e-2f46-4384-b53b-2f192676a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.311703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86c5e-2f46-4384-b53b-2f192676a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.312015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86c5e-2f46-4384-b53b-2f192676a4f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.337258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 38/75] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:50.338613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784826a1-bb35-48da-8331-310e7534de4e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.338911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784826a1-bb35-48da-8331-310e7534de4e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.339188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784826a1-bb35-48da-8331-310e7534de4e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.340543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 39/76] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:50.341302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784826a1-bb35-48da-8331-310e7534de4e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.369798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.389026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e86c5e-2f46-4384-b53b-2f192676a4f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.390496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e86c5e-2f46-4384-b53b-2f192676a4f0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.419273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.443244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784826a1-bb35-48da-8331-310e7534de4e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.475700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988798da-c9f8-4bb1-8815-d36b10312e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.476575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988798da-c9f8-4bb1-8815-d36b10312e6e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.476854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988798da-c9f8-4bb1-8815-d36b10312e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.477126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988798da-c9f8-4bb1-8815-d36b10312e6e None admin] PATH_INFO: `/v3/users/c25537e8f9b64e58ba6db076b2ad8db7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.478380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988798da-c9f8-4bb1-8815-d36b10312e6e None admin] RBAC: Authorizing `identity:get_user(user_id=c25537e8f9b64e58ba6db076b2ad8db7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.479856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988798da-c9f8-4bb1-8815-d36b10312e6e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.481517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 40/77] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/users/c25537e8f9b64e58ba6db076b2ad8db7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:50.482361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988798da-c9f8-4bb1-8815-d36b10312e6e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.486991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 38/78] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:50.488848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ded32-04cd-4eb5-8b93-f56f40ff4869 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.489143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ded32-04cd-4eb5-8b93-f56f40ff4869 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.489422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ded32-04cd-4eb5-8b93-f56f40ff4869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.505742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a62ded32-04cd-4eb5-8b93-f56f40ff4869 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:50.506937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a62ded32-04cd-4eb5-8b93-f56f40ff4869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:50.572799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 39/79] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:50.573699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ded32-04cd-4eb5-8b93-f56f40ff4869 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.576008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.582791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988798da-c9f8-4bb1-8815-d36b10312e6e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.617761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.618419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.618706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.618985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.619732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:50.620076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.621604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.629306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 41/80] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:50.630070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.637278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.674831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ded32-04cd-4eb5-8b93-f56f40ff4869 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.708055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde96d7c-6f97-4ce9-ba69-12a2329d956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.708844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde96d7c-6f97-4ce9-ba69-12a2329d956c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.709131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde96d7c-6f97-4ce9-ba69-12a2329d956c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.709409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde96d7c-6f97-4ce9-ba69-12a2329d956c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.719424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde96d7c-6f97-4ce9-ba69-12a2329d956c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:50.726955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076483-0cb2-47ce-b5d4-fcdabbbc08a7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fde96d7c-6f97-4ce9-ba69-12a2329d956c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:50.727751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:50.728707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:21:50.729439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 40/81] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:50.730418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde96d7c-6f97-4ce9-ba69-12a2329d956c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.765416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf3c94-05d4-4a2d-92f7-a7446e6d932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.766070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf3c94-05d4-4a2d-92f7-a7446e6d932a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.766360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf3c94-05d4-4a2d-92f7-a7446e6d932a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.766642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf3c94-05d4-4a2d-92f7-a7446e6d932a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.793110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.828494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde96d7c-6f97-4ce9-ba69-12a2329d956c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.832393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf3c94-05d4-4a2d-92f7-a7446e6d932a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.833856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf3c94-05d4-4a2d-92f7-a7446e6d932a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.851147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.862647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6cd29-4973-411d-bd5e-7b7926f9e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.863505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6cd29-4973-411d-bd5e-7b7926f9e560 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.863794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6cd29-4973-411d-bd5e-7b7926f9e560 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.864105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6cd29-4973-411d-bd5e-7b7926f9e560 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.865315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6cd29-4973-411d-bd5e-7b7926f9e560 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.866907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6cd29-4973-411d-bd5e-7b7926f9e560 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.868640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 41/82] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:50.869406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6cd29-4973-411d-bd5e-7b7926f9e560 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.930426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 42/83] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:50.931274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf3c94-05d4-4a2d-92f7-a7446e6d932a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.969629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6cd29-4973-411d-bd5e-7b7926f9e560 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.986852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.001970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a344a-a4bd-4f52-a5d1-e06cda4d3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.002753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a344a-a4bd-4f52-a5d1-e06cda4d3db0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.003039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a344a-a4bd-4f52-a5d1-e06cda4d3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.003419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a344a-a4bd-4f52-a5d1-e06cda4d3db0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.007229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a344a-a4bd-4f52-a5d1-e06cda4d3db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.009012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a344a-a4bd-4f52-a5d1-e06cda4d3db0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.010667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 42/84] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.011514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a344a-a4bd-4f52-a5d1-e06cda4d3db0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.029386 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf3c94-05d4-4a2d-92f7-a7446e6d932a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.063353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496f28-93ac-4a82-badd-1699266317cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.064260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496f28-93ac-4a82-badd-1699266317cf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.064540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496f28-93ac-4a82-badd-1699266317cf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.064812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496f28-93ac-4a82-badd-1699266317cf None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.066525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496f28-93ac-4a82-badd-1699266317cf None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.067976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496f28-93ac-4a82-badd-1699266317cf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.069591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 43/85] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.072732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496f28-93ac-4a82-badd-1699266317cf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.073083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.115126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a344a-a4bd-4f52-a5d1-e06cda4d3db0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.148967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.149633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.149921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.150202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.150948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:51.151257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.152670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.161044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 43/86] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.161044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.177677 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496f28-93ac-4a82-badd-1699266317cf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.202668 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.211168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.211815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.212127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.212405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.220977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] RBAC: Adding query filter params (role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=dac392a9fac04fbea9237070eefab8d7, user.id=9c716bbf92114911b27d0d40a4830e1f) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:51.220977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.220977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.220977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 44/87] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/role_assignments?user.id=9c716bbf92114911b27d0d40a4830e1f&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.220977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.267529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1c634-3584-44bd-b03e-08b0eeba1ae9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.290525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.305760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dbc5f-dfee-4d30-b181-547165a394f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.306647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dbc5f-dfee-4d30-b181-547165a394f0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.306923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dbc5f-dfee-4d30-b181-547165a394f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.307651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dbc5f-dfee-4d30-b181-547165a394f0 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.308550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dbc5f-dfee-4d30-b181-547165a394f0 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.310045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dbc5f-dfee-4d30-b181-547165a394f0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.317444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 44/88] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.317444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dbc5f-dfee-4d30-b181-547165a394f0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.352694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65a91-5bc1-4247-b78f-023497d79abb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.393591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035f26b-30b1-4893-bd84-a067a4a9f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.394971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035f26b-30b1-4893-bd84-a067a4a9f038 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.395243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035f26b-30b1-4893-bd84-a067a4a9f038 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.395504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035f26b-30b1-4893-bd84-a067a4a9f038 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.396380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035f26b-30b1-4893-bd84-a067a4a9f038 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.397839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035f26b-30b1-4893-bd84-a067a4a9f038 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.425779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dbc5f-dfee-4d30-b181-547165a394f0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.459443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569ac60-384f-4a92-9be6-9d9155802d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.460048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569ac60-384f-4a92-9be6-9d9155802d77 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.460336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569ac60-384f-4a92-9be6-9d9155802d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.460614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569ac60-384f-4a92-9be6-9d9155802d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.478084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 45/89] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:51 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:51.485024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035f26b-30b1-4893-bd84-a067a4a9f038 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.528474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.547812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569ac60-384f-4a92-9be6-9d9155802d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.549691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569ac60-384f-4a92-9be6-9d9155802d77 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.560688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.621686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035f26b-30b1-4893-bd84-a067a4a9f038 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.668824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d1b1-e9d3-4ab2-996f-7820416ce232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.669944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d1b1-e9d3-4ab2-996f-7820416ce232 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.670351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d1b1-e9d3-4ab2-996f-7820416ce232 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.670645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d1b1-e9d3-4ab2-996f-7820416ce232 None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.672287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d1b1-e9d3-4ab2-996f-7820416ce232 None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.674018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d1b1-e9d3-4ab2-996f-7820416ce232 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.677064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 46/90] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.677935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d1b1-e9d3-4ab2-996f-7820416ce232 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.697559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 45/91] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:51.698773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569ac60-384f-4a92-9be6-9d9155802d77 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.812420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d1b1-e9d3-4ab2-996f-7820416ce232 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.818097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.831071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.833069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569ac60-384f-4a92-9be6-9d9155802d77 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.856274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.857363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.857663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.857956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.858835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=dac392a9fac04fbea9237070eefab8d7, user.id=c25537e8f9b64e58ba6db076b2ad8db7) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:51.859201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.861424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.870410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 47/92] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/role_assignments?user.id=c25537e8f9b64e58ba6db076b2ad8db7&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.871738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.875557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d886-5b33-4298-903c-7273762490de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.876659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d886-5b33-4298-903c-7273762490de None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.876659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d886-5b33-4298-903c-7273762490de None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.876951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d886-5b33-4298-903c-7273762490de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.001052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301d886-5b33-4298-903c-7273762490de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:52.002734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301d886-5b33-4298-903c-7273762490de None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:52.045942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac45f5-2504-4dfb-b302-08038721a9ae None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.096554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7e767-cc85-445b-820c-622897e3f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.097870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e767-cc85-445b-820c-622897e3f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.098350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e767-cc85-445b-820c-622897e3f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.098819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7e767-cc85-445b-820c-622897e3f6a6 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.100693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7e767-cc85-445b-820c-622897e3f6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:52.101115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:52.102601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7e767-cc85-445b-820c-622897e3f6a6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:52.104776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 48/93] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:52.111676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7e767-cc85-445b-820c-622897e3f6a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.115841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 46/94] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:52.125605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d886-5b33-4298-903c-7273762490de None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.163631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:52.220520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7e767-cc85-445b-820c-622897e3f6a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.262932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.263510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.263795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.264099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.264943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] RBAC: Adding query filter params (role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=dac392a9fac04fbea9237070eefab8d7, user.id=9c716bbf92114911b27d0d40a4830e1f) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:52.265258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:52.267589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:52.280970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 49/95] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/role_assignments?user.id=9c716bbf92114911b27d0d40a4830e1f&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:52.322081 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d886-5b33-4298-903c-7273762490de None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.363515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf24e-fb76-4e9c-abec-66eb7702fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.364412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf24e-fb76-4e9c-abec-66eb7702fb10 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.364698 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf24e-fb76-4e9c-abec-66eb7702fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.364973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf24e-fb76-4e9c-abec-66eb7702fb10 None admin] PATH_INFO: `/v3/projects/42ea3ff0d5e24e67ae6084863021fffb` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.368743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf24e-fb76-4e9c-abec-66eb7702fb10 None admin] RBAC: Authorizing `identity:get_project(project_id=42ea3ff0d5e24e67ae6084863021fffb)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:52.370227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf24e-fb76-4e9c-abec-66eb7702fb10 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:52.372329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 47/96] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/projects/42ea3ff0d5e24e67ae6084863021fffb => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:52.378294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.529508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6558d69-b4ce-4365-a79e-986014284e6c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.546313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:52.577905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0861ee-eb9c-4fe1-ac2b-2e16cbe14f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.578572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0861ee-eb9c-4fe1-ac2b-2e16cbe14f08 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.578853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0861ee-eb9c-4fe1-ac2b-2e16cbe14f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.579127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0861ee-eb9c-4fe1-ac2b-2e16cbe14f08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.579983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0861ee-eb9c-4fe1-ac2b-2e16cbe14f08 None admin] RBAC: Adding query filter params (role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=42ea3ff0d5e24e67ae6084863021fffb, user.id=9c716bbf92114911b27d0d40a4830e1f) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:52.580300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0861ee-eb9c-4fe1-ac2b-2e16cbe14f08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:52.582448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0861ee-eb9c-4fe1-ac2b-2e16cbe14f08 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:52.592525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 50/97] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/role_assignments?user.id=9c716bbf92114911b27d0d40a4830e1f&scope.project.id=42ea3ff0d5e24e67ae6084863021fffb&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:54.117982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418779-168c-454a-ac3f-b4e1b1341d94 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.118488 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418779-168c-454a-ac3f-b4e1b1341d94 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.118582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418779-168c-454a-ac3f-b4e1b1341d94 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.120062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 48/98] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:54.125389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a1292-19f1-4ae9-adc4-4962b1594d41 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.125803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a1292-19f1-4ae9-adc4-4962b1594d41 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.126829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a1292-19f1-4ae9-adc4-4962b1594d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.149069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a90a1292-19f1-4ae9-adc4-4962b1594d41 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:54.150279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a90a1292-19f1-4ae9-adc4-4962b1594d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:54.229448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 51/99] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:54.269285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418779-168c-454a-ac3f-b4e1b1341d94 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.403654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.489998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418779-168c-454a-ac3f-b4e1b1341d94 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:54.540288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5b4d-ba18-44c2-b62c-1a43c9a1dea5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.540592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5b4d-ba18-44c2-b62c-1a43c9a1dea5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.540857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5b4d-ba18-44c2-b62c-1a43c9a1dea5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.542360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 52/100] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:54.542465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6470b82-8b01-4d21-961f-eb4512fcffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:54.543150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6470b82-8b01-4d21-961f-eb4512fcffc6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.543433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6470b82-8b01-4d21-961f-eb4512fcffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.543709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6470b82-8b01-4d21-961f-eb4512fcffc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.547085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9b6b8-9544-4b2d-8c5e-cbbe8fd14c96 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.547373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9b6b8-9544-4b2d-8c5e-cbbe8fd14c96 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.547658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9b6b8-9544-4b2d-8c5e-cbbe8fd14c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.571036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-31a9b6b8-9544-4b2d-8c5e-cbbe8fd14c96 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:54.572239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-31a9b6b8-9544-4b2d-8c5e-cbbe8fd14c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:54.574585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6470b82-8b01-4d21-961f-eb4512fcffc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e6470b82-8b01-4d21-961f-eb4512fcffc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:54.582456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:54.583288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:21:54.584079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 49/101] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:54.594896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6470b82-8b01-4d21-961f-eb4512fcffc6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.713673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 53/102] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:54.743948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9b6b8-9544-4b2d-8c5e-cbbe8fd14c96 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.826348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.840879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6470b82-8b01-4d21-961f-eb4512fcffc6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:54.882265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.914785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0318813-1319-4873-8783-36bd1f147f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:54.915457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318813-1319-4873-8783-36bd1f147f87 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.915741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318813-1319-4873-8783-36bd1f147f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.916055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318813-1319-4873-8783-36bd1f147f87 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.916812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0318813-1319-4873-8783-36bd1f147f87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:54.917119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0318813-1319-4873-8783-36bd1f147f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:54.918504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0318813-1319-4873-8783-36bd1f147f87 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:54.937546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 50/103] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:54.941943 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dd14-062f-4c3c-ac58-ca847d5b4410 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.942239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dd14-062f-4c3c-ac58-ca847d5b4410 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.942556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1dd14-062f-4c3c-ac58-ca847d5b4410 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.950894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 51/104] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:54.951741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1dd14-062f-4c3c-ac58-ca847d5b4410 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.965262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9b6b8-9544-4b2d-8c5e-cbbe8fd14c96 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.015944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d790a1-5dd1-4c0f-bacb-da1ba395e740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.019322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d790a1-5dd1-4c0f-bacb-da1ba395e740 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.019322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d790a1-5dd1-4c0f-bacb-da1ba395e740 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.019322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d790a1-5dd1-4c0f-bacb-da1ba395e740 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.029205 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d790a1-5dd1-4c0f-bacb-da1ba395e740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f1d790a1-5dd1-4c0f-bacb-da1ba395e740 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:55.037446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:55.038262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:55.039112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:55.041251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 54/105] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:55.042594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29826c1-c43c-4892-b5c3-1114f2d75887 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.043064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29826c1-c43c-4892-b5c3-1114f2d75887 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.043495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29826c1-c43c-4892-b5c3-1114f2d75887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.061694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f29826c1-c43c-4892-b5c3-1114f2d75887 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:55.063132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f29826c1-c43c-4892-b5c3-1114f2d75887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:55.152323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1dd14-062f-4c3c-ac58-ca847d5b4410 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 55/106] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:55.192798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29826c1-c43c-4892-b5c3-1114f2d75887 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.220709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023eb1-8bd5-4938-9519-3fea29a1cb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.221518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023eb1-8bd5-4938-9519-3fea29a1cb20 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.221832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023eb1-8bd5-4938-9519-3fea29a1cb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.222639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023eb1-8bd5-4938-9519-3fea29a1cb20 None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.224603 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3023eb1-8bd5-4938-9519-3fea29a1cb20 None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.226060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3023eb1-8bd5-4938-9519-3fea29a1cb20 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.227695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 52/107] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.234077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023eb1-8bd5-4938-9519-3fea29a1cb20 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.235749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.324324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.385539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023eb1-8bd5-4938-9519-3fea29a1cb20 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.400480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29826c1-c43c-4892-b5c3-1114f2d75887 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.428617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf10bfd-0f16-4114-8859-594afe7d807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.429439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf10bfd-0f16-4114-8859-594afe7d807c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.429723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf10bfd-0f16-4114-8859-594afe7d807c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.429998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf10bfd-0f16-4114-8859-594afe7d807c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.450039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf10bfd-0f16-4114-8859-594afe7d807c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7cf10bfd-0f16-4114-8859-594afe7d807c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:55.459011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:55.459841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:55.460663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:21:55.461214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4197635-60e9-43e3-8f4d-7b5e6614b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.461306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 53/108] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:55.461371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197635-60e9-43e3-8f4d-7b5e6614b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.461371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197635-60e9-43e3-8f4d-7b5e6614b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.461371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197635-60e9-43e3-8f4d-7b5e6614b4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.461526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf10bfd-0f16-4114-8859-594afe7d807c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.462549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4197635-60e9-43e3-8f4d-7b5e6614b4a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:55.462549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4197635-60e9-43e3-8f4d-7b5e6614b4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.466920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4197635-60e9-43e3-8f4d-7b5e6614b4a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.474933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 56/109] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.476593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f35df-41d3-4707-b036-05037a12c9c4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.476886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f35df-41d3-4707-b036-05037a12c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.477430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f35df-41d3-4707-b036-05037a12c9c4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.479312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 57/110] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:55.480048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f35df-41d3-4707-b036-05037a12c9c4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.575208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.576167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf10bfd-0f16-4114-8859-594afe7d807c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.583998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.590649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f35df-41d3-4707-b036-05037a12c9c4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.611366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc17e6-5f1e-4232-b6da-08e6b34c2d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.612248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc17e6-5f1e-4232-b6da-08e6b34c2d89 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.613299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc17e6-5f1e-4232-b6da-08e6b34c2d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.613809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc17e6-5f1e-4232-b6da-08e6b34c2d89 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.615498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc17e6-5f1e-4232-b6da-08e6b34c2d89 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.616975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc17e6-5f1e-4232-b6da-08e6b34c2d89 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.618693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 54/111] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.619532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc17e6-5f1e-4232-b6da-08e6b34c2d89 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.631400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb47e06-b8b8-4691-9af9-6e643d77d083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.632209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb47e06-b8b8-4691-9af9-6e643d77d083 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.632499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb47e06-b8b8-4691-9af9-6e643d77d083 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.632779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb47e06-b8b8-4691-9af9-6e643d77d083 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.633788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb47e06-b8b8-4691-9af9-6e643d77d083 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:55.634101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb47e06-b8b8-4691-9af9-6e643d77d083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.635480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb47e06-b8b8-4691-9af9-6e643d77d083 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.649230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 58/112] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.649230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5c0c-0003-45d4-ba9c-10b92322ef88 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.649230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5c0c-0003-45d4-ba9c-10b92322ef88 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.649230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5c0c-0003-45d4-ba9c-10b92322ef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.665143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-084e5c0c-0003-45d4-ba9c-10b92322ef88 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:55.666603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-084e5c0c-0003-45d4-ba9c-10b92322ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:55.725169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc17e6-5f1e-4232-b6da-08e6b34c2d89 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.751927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 59/113] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:55.751927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f1e9-1c81-4793-8f30-78252c667119 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.751927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f1e9-1c81-4793-8f30-78252c667119 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.751927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0f1e9-1c81-4793-8f30-78252c667119 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.752265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 60/114] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:55.752914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f1e9-1c81-4793-8f30-78252c667119 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.765992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c09ad-7436-4371-8bbf-e7999b8a626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.766876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c09ad-7436-4371-8bbf-e7999b8a626e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.767161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c09ad-7436-4371-8bbf-e7999b8a626e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.767439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c09ad-7436-4371-8bbf-e7999b8a626e None admin] PATH_INFO: `/v3/users/d958fd8cfc2c470cb9932c3df1eae962` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.784564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c09ad-7436-4371-8bbf-e7999b8a626e None admin] RBAC: Authorizing `identity:get_user(user_id=d958fd8cfc2c470cb9932c3df1eae962)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.786061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c09ad-7436-4371-8bbf-e7999b8a626e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.791882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 55/115] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/users/d958fd8cfc2c470cb9932c3df1eae962 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.791882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c09ad-7436-4371-8bbf-e7999b8a626e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.822266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.848373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.872799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0f1e9-1c81-4793-8f30-78252c667119 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.895682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c09ad-7436-4371-8bbf-e7999b8a626e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.914719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20387dc7-181e-4b3c-98c9-176918ffbf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.915628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20387dc7-181e-4b3c-98c9-176918ffbf00 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.915942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20387dc7-181e-4b3c-98c9-176918ffbf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.916222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20387dc7-181e-4b3c-98c9-176918ffbf00 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7/users/9c716bbf92114911b27d0d40a4830e1f/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.918322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20387dc7-181e-4b3c-98c9-176918ffbf00 None admin] RBAC: Authorizing `identity:create_grant(project_id=dac392a9fac04fbea9237070eefab8d7, user_id=9c716bbf92114911b27d0d40a4830e1f, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.919835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20387dc7-181e-4b3c-98c9-176918ffbf00 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.933422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6e841-35fc-49aa-87f5-bd934796b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.934295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e841-35fc-49aa-87f5-bd934796b02b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.934580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e841-35fc-49aa-87f5-bd934796b02b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.934858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e841-35fc-49aa-87f5-bd934796b02b None admin] PATH_INFO: `/v3/users/c25537e8f9b64e58ba6db076b2ad8db7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.936096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6e841-35fc-49aa-87f5-bd934796b02b None admin] RBAC: Authorizing `identity:get_user(user_id=c25537e8f9b64e58ba6db076b2ad8db7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.937532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6e841-35fc-49aa-87f5-bd934796b02b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.939153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 56/116] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/users/c25537e8f9b64e58ba6db076b2ad8db7 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.940297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb3e3-bee2-4c5e-9346-636741c40626 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.941120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb3e3-bee2-4c5e-9346-636741c40626 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.941402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb3e3-bee2-4c5e-9346-636741c40626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.958062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4a4fb3e3-bee2-4c5e-9346-636741c40626 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:55.959243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4a4fb3e3-bee2-4c5e-9346-636741c40626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:55.986107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 61/117] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:55 2022] PUT /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7/users/9c716bbf92114911b27d0d40a4830e1f/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:55.986872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20387dc7-181e-4b3c-98c9-176918ffbf00 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.035974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 57/118] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:56.037178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb3e3-bee2-4c5e-9346-636741c40626 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.077935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.114261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20387dc7-181e-4b3c-98c9-176918ffbf00 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.155770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3d634-a624-4993-9cc2-4f50a0d94c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.156623 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d634-a624-4993-9cc2-4f50a0d94c77 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.156904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d634-a624-4993-9cc2-4f50a0d94c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.157180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d634-a624-4993-9cc2-4f50a0d94c77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.158180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb3e3-bee2-4c5e-9346-636741c40626 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.164136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.167889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3d634-a624-4993-9cc2-4f50a0d94c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b6a3d634-a624-4993-9cc2-4f50a0d94c77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:56.176817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:56.177652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:56.178624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 62/119] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:56.179394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3d634-a624-4993-9cc2-4f50a0d94c77 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.195383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2169-cd4f-42b9-a37e-c94c753a2887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.196073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2169-cd4f-42b9-a37e-c94c753a2887 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.196363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2169-cd4f-42b9-a37e-c94c753a2887 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.196646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2169-cd4f-42b9-a37e-c94c753a2887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.265450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde2169-cd4f-42b9-a37e-c94c753a2887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.266843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde2169-cd4f-42b9-a37e-c94c753a2887 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.295454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.304259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3d634-a624-4993-9cc2-4f50a0d94c77 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.344407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0dc8a-8a62-458e-b174-a0cf2d50d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.345266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0dc8a-8a62-458e-b174-a0cf2d50d177 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.345551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0dc8a-8a62-458e-b174-a0cf2d50d177 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.345831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0dc8a-8a62-458e-b174-a0cf2d50d177 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.347600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0dc8a-8a62-458e-b174-a0cf2d50d177 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.348996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0dc8a-8a62-458e-b174-a0cf2d50d177 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.350864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 63/120] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.351866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f29f-b7b8-4e63-967e-f87ed41c8dba None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.352177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f29f-b7b8-4e63-967e-f87ed41c8dba None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.352459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f29f-b7b8-4e63-967e-f87ed41c8dba None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.356022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 64/121] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:56.356022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765f29f-b7b8-4e63-967e-f87ed41c8dba None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.375322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 58/122] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:56.376217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2169-cd4f-42b9-a37e-c94c753a2887 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.428492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.466151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765f29f-b7b8-4e63-967e-f87ed41c8dba None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.488625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2169-cd4f-42b9-a37e-c94c753a2887 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.501878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283a06-4546-4c5b-bf26-bf51e5c05f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.502674 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283a06-4546-4c5b-bf26-bf51e5c05f7c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.502953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283a06-4546-4c5b-bf26-bf51e5c05f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.503278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283a06-4546-4c5b-bf26-bf51e5c05f7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.504480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a283a06-4546-4c5b-bf26-bf51e5c05f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.505931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a283a06-4546-4c5b-bf26-bf51e5c05f7c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.507548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 65/123] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.508310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283a06-4546-4c5b-bf26-bf51e5c05f7c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.519235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.525062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e49c9-cac1-43a3-96ec-284e8ac69ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.525713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e49c9-cac1-43a3-96ec-284e8ac69ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.525996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e49c9-cac1-43a3-96ec-284e8ac69ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.526286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e49c9-cac1-43a3-96ec-284e8ac69ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.527018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e49c9-cac1-43a3-96ec-284e8ac69ba6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:56.527325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e49c9-cac1-43a3-96ec-284e8ac69ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.528872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e49c9-cac1-43a3-96ec-284e8ac69ba6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.537406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 59/124] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.538411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848bfce-837d-4cc2-892a-6d92b6cecfbf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.538913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848bfce-837d-4cc2-892a-6d92b6cecfbf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.539017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848bfce-837d-4cc2-892a-6d92b6cecfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.556217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0848bfce-837d-4cc2-892a-6d92b6cecfbf None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:56.558581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0848bfce-837d-4cc2-892a-6d92b6cecfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:56.609935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283a06-4546-4c5b-bf26-bf51e5c05f7c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.632194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 60/125] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:56.641118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848bfce-837d-4cc2-892a-6d92b6cecfbf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.647645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02997b0c-d4f0-460d-956e-f7bde71cef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.648779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02997b0c-d4f0-460d-956e-f7bde71cef48 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.649239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02997b0c-d4f0-460d-956e-f7bde71cef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.649689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02997b0c-d4f0-460d-956e-f7bde71cef48 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7/users/c25537e8f9b64e58ba6db076b2ad8db7/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.651892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02997b0c-d4f0-460d-956e-f7bde71cef48 None admin] RBAC: Authorizing `identity:create_grant(project_id=dac392a9fac04fbea9237070eefab8d7, user_id=c25537e8f9b64e58ba6db076b2ad8db7, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.653696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02997b0c-d4f0-460d-956e-f7bde71cef48 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.656194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.745167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848bfce-837d-4cc2-892a-6d92b6cecfbf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.749859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 66/126] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:56 2022] PUT /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7/users/c25537e8f9b64e58ba6db076b2ad8db7/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:56.761656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02997b0c-d4f0-460d-956e-f7bde71cef48 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.785977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.802366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1623b9-0f3c-410e-9eb8-eb0cccc0b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.803654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1623b9-0f3c-410e-9eb8-eb0cccc0b25f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.804571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1623b9-0f3c-410e-9eb8-eb0cccc0b25f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.805978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1623b9-0f3c-410e-9eb8-eb0cccc0b25f None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.807731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1623b9-0f3c-410e-9eb8-eb0cccc0b25f None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.809592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1623b9-0f3c-410e-9eb8-eb0cccc0b25f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.818406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 61/127] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.818406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1623b9-0f3c-410e-9eb8-eb0cccc0b25f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.909889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02997b0c-d4f0-460d-956e-f7bde71cef48 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.936587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1623b9-0f3c-410e-9eb8-eb0cccc0b25f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.955945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce823df4-9bb4-4cda-ad36-55eeb8d8f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.956883 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce823df4-9bb4-4cda-ad36-55eeb8d8f7cb None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.957175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce823df4-9bb4-4cda-ad36-55eeb8d8f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.957459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce823df4-9bb4-4cda-ad36-55eeb8d8f7cb None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.958592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce823df4-9bb4-4cda-ad36-55eeb8d8f7cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.961215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce823df4-9bb4-4cda-ad36-55eeb8d8f7cb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.975132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c09cbe-4063-4a9e-a3e5-4738b77e4ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.976037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c09cbe-4063-4a9e-a3e5-4738b77e4ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.976320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c09cbe-4063-4a9e-a3e5-4738b77e4ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.976593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c09cbe-4063-4a9e-a3e5-4738b77e4ba8 None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.980261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c09cbe-4063-4a9e-a3e5-4738b77e4ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.980484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c09cbe-4063-4a9e-a3e5-4738b77e4ba8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.982158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 62/128] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.982913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c09cbe-4063-4a9e-a3e5-4738b77e4ba8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.044941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 67/129] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:21:56 2022] POST /identity/v3/projects => generated 302 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:57.046074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce823df4-9bb4-4cda-ad36-55eeb8d8f7cb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.070890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.144106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.160807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c09cbe-4063-4a9e-a3e5-4738b77e4ba8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.234506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce823df4-9bb4-4cda-ad36-55eeb8d8f7cb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.238422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b068730-e6c1-4591-b5e2-820636b135a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.239243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068730-e6c1-4591-b5e2-820636b135a8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.239526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068730-e6c1-4591-b5e2-820636b135a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.239800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068730-e6c1-4591-b5e2-820636b135a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.268234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b068730-e6c1-4591-b5e2-820636b135a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2b068730-e6c1-4591-b5e2-820636b135a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:57.276073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:57.277088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:57.277858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:21:57.279303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 63/130] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:57.279303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b068730-e6c1-4591-b5e2-820636b135a8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.313073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.313711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.313962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.314245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.315090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] RBAC: Adding query filter params (role.id=e9ba98fdb77f4aadae316c27d3e158ae, scope.project.id=dac392a9fac04fbea9237070eefab8d7, user.id=d958fd8cfc2c470cb9932c3df1eae962) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:57.315410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.317159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.323566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 68/131] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/role_assignments?user.id=d958fd8cfc2c470cb9932c3df1eae962&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=e9ba98fdb77f4aadae316c27d3e158ae => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:57.327949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.450885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adcdc6-632a-42d8-8da0-01eb8337ead3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.469165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.511116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.511812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.513460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.513460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.513809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:57.514121 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.515880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.518476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b068730-e6c1-4591-b5e2-820636b135a8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.531533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 69/132] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:57.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.546151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.568699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3b65b-7be1-4927-a351-a0a11ca8388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.569470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3b65b-7be1-4927-a351-a0a11ca8388f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.569965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3b65b-7be1-4927-a351-a0a11ca8388f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.570447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3b65b-7be1-4927-a351-a0a11ca8388f None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.572101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3b65b-7be1-4927-a351-a0a11ca8388f None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.573798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3b65b-7be1-4927-a351-a0a11ca8388f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.575808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 64/133] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:57.584787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3b65b-7be1-4927-a351-a0a11ca8388f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.711837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabfffd-5090-43b7-b197-10fc92e82e0d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.734797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3b65b-7be1-4927-a351-a0a11ca8388f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.774527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca38a-3cbb-47d8-8b46-74186383a00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.775841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca38a-3cbb-47d8-8b46-74186383a00a None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.776514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca38a-3cbb-47d8-8b46-74186383a00a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.777396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca38a-3cbb-47d8-8b46-74186383a00a None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7/users/9c716bbf92114911b27d0d40a4830e1f/roles/414930bf02ef4277b0b66bc57f1f1628` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.779944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dca38a-3cbb-47d8-8b46-74186383a00a None admin] RBAC: Authorizing `identity:create_grant(project_id=dac392a9fac04fbea9237070eefab8d7, user_id=9c716bbf92114911b27d0d40a4830e1f, role_id=414930bf02ef4277b0b66bc57f1f1628)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.781888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dca38a-3cbb-47d8-8b46-74186383a00a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.795369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94615743-27a5-4e64-8694-c30381f28407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.796719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94615743-27a5-4e64-8694-c30381f28407 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.797204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94615743-27a5-4e64-8694-c30381f28407 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.797730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94615743-27a5-4e64-8694-c30381f28407 None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.799208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94615743-27a5-4e64-8694-c30381f28407 None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.801587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94615743-27a5-4e64-8694-c30381f28407 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.803473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 70/134] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:57.808919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94615743-27a5-4e64-8694-c30381f28407 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.864415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.872540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 65/135] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:57 2022] PUT /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7/users/9c716bbf92114911b27d0d40a4830e1f/roles/414930bf02ef4277b0b66bc57f1f1628 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:57.936818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94615743-27a5-4e64-8694-c30381f28407 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.974090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c74d8-e415-4821-8693-e1f44d905329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.975332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c74d8-e415-4821-8693-e1f44d905329 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.975851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c74d8-e415-4821-8693-e1f44d905329 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.976367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c74d8-e415-4821-8693-e1f44d905329 None admin] PATH_INFO: `/v3/projects/42ea3ff0d5e24e67ae6084863021fffb` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.977874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c74d8-e415-4821-8693-e1f44d905329 None admin] RBAC: Authorizing `identity:get_project(project_id=42ea3ff0d5e24e67ae6084863021fffb)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.979588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c74d8-e415-4821-8693-e1f44d905329 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.981682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 71/136] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/projects/42ea3ff0d5e24e67ae6084863021fffb => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:57.988083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca38a-3cbb-47d8-8b46-74186383a00a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:58.052456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:58.116057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca38a-3cbb-47d8-8b46-74186383a00a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:58.161435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78f100-7661-42ea-9758-1b5ca5886a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:58.162330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78f100-7661-42ea-9758-1b5ca5886a0e None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:58.162616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78f100-7661-42ea-9758-1b5ca5886a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:58.162894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78f100-7661-42ea-9758-1b5ca5886a0e None admin] PATH_INFO: `/v3/projects/42ea3ff0d5e24e67ae6084863021fffb/users/9c716bbf92114911b27d0d40a4830e1f/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:58.165630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78f100-7661-42ea-9758-1b5ca5886a0e None admin] RBAC: Authorizing `identity:create_grant(project_id=42ea3ff0d5e24e67ae6084863021fffb, user_id=9c716bbf92114911b27d0d40a4830e1f, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:58.167109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78f100-7661-42ea-9758-1b5ca5886a0e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:58.247645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 66/137] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:57 2022] PUT /identity/v3/projects/42ea3ff0d5e24e67ae6084863021fffb/users/9c716bbf92114911b27d0d40a4830e1f/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:58.542197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4571a9-5255-4f01-9aab-3a8f6c3e0fe2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:58.542685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4571a9-5255-4f01-9aab-3a8f6c3e0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:58.542773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4571a9-5255-4f01-9aab-3a8f6c3e0fe2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:58.544172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 72/138] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:58.550071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a024b-ef3c-4ded-912d-86be8d270f63 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:58.550365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a024b-ef3c-4ded-912d-86be8d270f63 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:58.550646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a024b-ef3c-4ded-912d-86be8d270f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:58.576484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-902a024b-ef3c-4ded-912d-86be8d270f63 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:58.577683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-902a024b-ef3c-4ded-912d-86be8d270f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:58.665464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 67/139] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:58.713420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4571a9-5255-4f01-9aab-3a8f6c3e0fe2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:58.860266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4571a9-5255-4f01-9aab-3a8f6c3e0fe2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:58.870723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:58.908002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda43dd8-7dc3-4f77-86e3-7f173f528b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:58.908863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda43dd8-7dc3-4f77-86e3-7f173f528b0e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:58.909167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda43dd8-7dc3-4f77-86e3-7f173f528b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:58.909444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda43dd8-7dc3-4f77-86e3-7f173f528b0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:58.920602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda43dd8-7dc3-4f77-86e3-7f173f528b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-fda43dd8-7dc3-4f77-86e3-7f173f528b0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:58.928486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:58.929340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:58.930068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:21:58.931379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 73/140] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:58.935695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a024b-ef3c-4ded-912d-86be8d270f63 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:59.000971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:59.088549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a024b-ef3c-4ded-912d-86be8d270f63 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:59.134774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:59.135362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:59.135648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:59.135945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:59.136701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:59.137013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:59.138398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:59.154571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 68/141] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:59.160147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda43dd8-7dc3-4f77-86e3-7f173f528b0e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:59.323894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda43dd8-7dc3-4f77-86e3-7f173f528b0e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:59.361879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750ab7c-91b3-4c92-9d8e-7ade898a07a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:59.363300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ab7c-91b3-4c92-9d8e-7ade898a07a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:59.363579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ab7c-91b3-4c92-9d8e-7ade898a07a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:59.363850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ab7c-91b3-4c92-9d8e-7ade898a07a7 None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:59.367920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750ab7c-91b3-4c92-9d8e-7ade898a07a7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:59.369394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750ab7c-91b3-4c92-9d8e-7ade898a07a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:59.371038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 74/142] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:59 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:59.376661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:59.486213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:59.495387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f354b33-720d-45c8-80b8-fc94a8618484 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:59.537965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72d987-94e5-45f3-a05e-0ae2ac615a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:59.538693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72d987-94e5-45f3-a05e-0ae2ac615a91 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:59.538981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72d987-94e5-45f3-a05e-0ae2ac615a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:59.539265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72d987-94e5-45f3-a05e-0ae2ac615a91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:59.622394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72d987-94e5-45f3-a05e-0ae2ac615a91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:59.624283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72d987-94e5-45f3-a05e-0ae2ac615a91 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:59.740773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:59.745951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 69/143] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:59.757000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750ab7c-91b3-4c92-9d8e-7ade898a07a7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:59.817490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:59.902144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750ab7c-91b3-4c92-9d8e-7ade898a07a7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:59.948501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3de990-8902-4590-8c79-6d5857abf343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:59.949368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de990-8902-4590-8c79-6d5857abf343 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:59.949650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de990-8902-4590-8c79-6d5857abf343 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:59.949930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de990-8902-4590-8c79-6d5857abf343 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:59.956673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3de990-8902-4590-8c79-6d5857abf343 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:59.958135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3de990-8902-4590-8c79-6d5857abf343 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:59.959856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 75/144] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:59 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:59.965980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72d987-94e5-45f3-a05e-0ae2ac615a91 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:00.027659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f695-f400-4128-a3bc-8401db3f4db4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.027953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f695-f400-4128-a3bc-8401db3f4db4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.028175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584f695-f400-4128-a3bc-8401db3f4db4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.031819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 76/145] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:00.035016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01606e1-e2b7-4129-a4d0-a646c28fbbbc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.035317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01606e1-e2b7-4129-a4d0-a646c28fbbbc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.035576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01606e1-e2b7-4129-a4d0-a646c28fbbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.068859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c01606e1-e2b7-4129-a4d0-a646c28fbbbc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:00.070144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c01606e1-e2b7-4129-a4d0-a646c28fbbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:00.118615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72d987-94e5-45f3-a05e-0ae2ac615a91 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:00.191784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 77/146] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:00.198304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:00.198977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.199263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.199547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.200407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] RBAC: Adding query filter params (role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=dac392a9fac04fbea9237070eefab8d7, user.id=9c716bbf92114911b27d0d40a4830e1f) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:00.200724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:00.202165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:00.215020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 70/147] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:59 2022] GET /identity/v3/role_assignments?user.id=9c716bbf92114911b27d0d40a4830e1f&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:00.227542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01606e1-e2b7-4129-a4d0-a646c28fbbbc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:00.285559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:00.372851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01606e1-e2b7-4129-a4d0-a646c28fbbbc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:00.418957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0854a-ee81-438e-9a32-949f0b4fd0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:00.420182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0854a-ee81-438e-9a32-949f0b4fd0ad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.420659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0854a-ee81-438e-9a32-949f0b4fd0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.421130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0854a-ee81-438e-9a32-949f0b4fd0ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.440246 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0854a-ee81-438e-9a32-949f0b4fd0ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6fa0854a-ee81-438e-9a32-949f0b4fd0ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:00.448361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:00.449331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:00.450073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:00.452897 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 78/148] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:00.458948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:00.549640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:00.597784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13afee4-ba55-47c0-831e-8b644ea0ad1b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:00.642284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:00.642909 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.643195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.643505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.644282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:00.644593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:00.645972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:00.659873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 71/149] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:00.664860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:00.665618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e717b-8235-432c-866a-5b3b68bda3d6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.666119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e717b-8235-432c-866a-5b3b68bda3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.666601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e717b-8235-432c-866a-5b3b68bda3d6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.668419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 79/150] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:00.675864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8cb4c-5539-4ff5-8914-2007e59d25ed None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.676218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8cb4c-5539-4ff5-8914-2007e59d25ed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.676499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8cb4c-5539-4ff5-8914-2007e59d25ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.698315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-24a8cb4c-5539-4ff5-8914-2007e59d25ed None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:00.701004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-24a8cb4c-5539-4ff5-8914-2007e59d25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:00.787299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 80/151] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:00.820848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8cb4c-5539-4ff5-8914-2007e59d25ed None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:00.852537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:00.866115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323c3c-5aa1-4429-9b90-f4d600b1f197 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:00.892314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:00.903657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f2dc5-bdd4-4bce-99ae-7d030a23a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:00.904865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2dc5-bdd4-4bce-99ae-7d030a23a458 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.905587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2dc5-bdd4-4bce-99ae-7d030a23a458 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.906066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2dc5-bdd4-4bce-99ae-7d030a23a458 None admin] PATH_INFO: `/v3/users/c25537e8f9b64e58ba6db076b2ad8db7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.907513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f2dc5-bdd4-4bce-99ae-7d030a23a458 None admin] RBAC: Authorizing `identity:get_user(user_id=c25537e8f9b64e58ba6db076b2ad8db7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:00.910017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f2dc5-bdd4-4bce-99ae-7d030a23a458 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:00.911897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 72/152] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:00 2022] GET /identity/v3/users/c25537e8f9b64e58ba6db076b2ad8db7 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:00.917771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814484d-ffa8-496e-8e64-21d381d785f1 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.918433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814484d-ffa8-496e-8e64-21d381d785f1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.918946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814484d-ffa8-496e-8e64-21d381d785f1 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.920803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 73/153] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:00.921648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814484d-ffa8-496e-8e64-21d381d785f1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:00.941951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8cb4c-5539-4ff5-8914-2007e59d25ed None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:00.994373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a10863-f860-4e96-b811-baac1f632615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:00.995771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10863-f860-4e96-b811-baac1f632615 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.996679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10863-f860-4e96-b811-baac1f632615 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.997443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a10863-f860-4e96-b811-baac1f632615 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.999664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a10863-f860-4e96-b811-baac1f632615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.002331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a10863-f860-4e96-b811-baac1f632615 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.005078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 81/154] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:01.010855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408ed5-10e0-47cf-b22c-d0dfe525b9ba None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.010855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408ed5-10e0-47cf-b22c-d0dfe525b9ba None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.010855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408ed5-10e0-47cf-b22c-d0dfe525b9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.028620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fa408ed5-10e0-47cf-b22c-d0dfe525b9ba None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:01.029688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fa408ed5-10e0-47cf-b22c-d0dfe525b9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:01.060428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814484d-ffa8-496e-8e64-21d381d785f1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.108024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 82/155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:01.108024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa408ed5-10e0-47cf-b22c-d0dfe525b9ba None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.116670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c6462-f75a-4592-83f6-9d3755efaeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.117345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c6462-f75a-4592-83f6-9d3755efaeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.119110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c6462-f75a-4592-83f6-9d3755efaeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.119426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c6462-f75a-4592-83f6-9d3755efaeb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.152465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.198097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.208940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c6462-f75a-4592-83f6-9d3755efaeb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.210432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c6462-f75a-4592-83f6-9d3755efaeb0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.240385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa408ed5-10e0-47cf-b22c-d0dfe525b9ba None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.275875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1ec1a-4097-4ae0-aa6e-18df1bc9f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.276565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ec1a-4097-4ae0-aa6e-18df1bc9f3b8 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.276848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ec1a-4097-4ae0-aa6e-18df1bc9f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.277124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1ec1a-4097-4ae0-aa6e-18df1bc9f3b8 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.277833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1ec1a-4097-4ae0-aa6e-18df1bc9f3b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.279270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1ec1a-4097-4ae0-aa6e-18df1bc9f3b8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.311443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 74/156] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:01.312337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c6462-f75a-4592-83f6-9d3755efaeb0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.374864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 83/157] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:01 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:01.376123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d9212-f907-46cd-a910-01dca2a99f7f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.376411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d9212-f907-46cd-a910-01dca2a99f7f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.376939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d9212-f907-46cd-a910-01dca2a99f7f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.378121 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 84/158] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:01.381361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f656a4a-ed4e-4d30-a30a-12a1cfbd362f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.381739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f656a4a-ed4e-4d30-a30a-12a1cfbd362f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.382092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f656a4a-ed4e-4d30-a30a-12a1cfbd362f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.384236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 85/159] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:01.385034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f656a4a-ed4e-4d30-a30a-12a1cfbd362f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.417361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.427052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c6462-f75a-4592-83f6-9d3755efaeb0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.467740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd9bf-38d1-421b-aabe-e966ceddcec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.468883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd9bf-38d1-421b-aabe-e966ceddcec7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.469229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd9bf-38d1-421b-aabe-e966ceddcec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.469514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd9bf-38d1-421b-aabe-e966ceddcec7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.480513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.485120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edd9bf-38d1-421b-aabe-e966ceddcec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-81edd9bf-38d1-421b-aabe-e966ceddcec7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:01.495838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:01.496976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:01.497926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 75/160] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:01.498681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee789b-a7cf-4caa-a168-7a3625270eea None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.498839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee789b-a7cf-4caa-a168-7a3625270eea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.499358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee789b-a7cf-4caa-a168-7a3625270eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.511939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f656a4a-ed4e-4d30-a30a-12a1cfbd362f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.525949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4bee789b-a7cf-4caa-a168-7a3625270eea None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:01.527182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4bee789b-a7cf-4caa-a168-7a3625270eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:01.550960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2f294-ea23-42d4-a921-b449d9f96785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.551822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f294-ea23-42d4-a921-b449d9f96785 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.552925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f294-ea23-42d4-a921-b449d9f96785 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.553205 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2f294-ea23-42d4-a921-b449d9f96785 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.554580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2f294-ea23-42d4-a921-b449d9f96785 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.556167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2f294-ea23-42d4-a921-b449d9f96785 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.557584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 86/161] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:01.561152 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17445e3-d8cb-4563-8f18-82c5b31a27d0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.561434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17445e3-d8cb-4563-8f18-82c5b31a27d0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.561709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17445e3-d8cb-4563-8f18-82c5b31a27d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.579186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b17445e3-d8cb-4563-8f18-82c5b31a27d0 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:01.581579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b17445e3-d8cb-4563-8f18-82c5b31a27d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:01.608275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 76/162] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:01.616100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee789b-a7cf-4caa-a168-7a3625270eea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.657424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 87/163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:01.659260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17445e3-d8cb-4563-8f18-82c5b31a27d0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.719967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.750463 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee789b-a7cf-4caa-a168-7a3625270eea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.765298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.792050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17445e3-d8cb-4563-8f18-82c5b31a27d0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.796538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.797329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.797725 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.798103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.799131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:01.799368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.801036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.811800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 77/164] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:01.813582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.841291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.841963 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.842523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.842811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.843648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=dac392a9fac04fbea9237070eefab8d7, user.id=c25537e8f9b64e58ba6db076b2ad8db7) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:01.844672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.848274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.854561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 88/165] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/role_assignments?user.id=c25537e8f9b64e58ba6db076b2ad8db7&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:01.855374 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.961296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcacbe-2f91-4916-a0f9-85a70eee03e3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.007947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf688d2-6432-4d19-8f51-c8d302656e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.009127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf688d2-6432-4d19-8f51-c8d302656e80 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.009127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf688d2-6432-4d19-8f51-c8d302656e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.009450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf688d2-6432-4d19-8f51-c8d302656e80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.011880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab600-e58a-4840-b5be-93ca6d927679 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.023788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf688d2-6432-4d19-8f51-c8d302656e80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fdf688d2-6432-4d19-8f51-c8d302656e80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:02.033133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:02.034807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:02.035586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 78/166] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:02.036447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf688d2-6432-4d19-8f51-c8d302656e80 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.040571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.052507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f61d5e-7f7c-4a8a-830a-b9ad4bf73405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.053312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f61d5e-7f7c-4a8a-830a-b9ad4bf73405 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.053591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f61d5e-7f7c-4a8a-830a-b9ad4bf73405 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.053862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f61d5e-7f7c-4a8a-830a-b9ad4bf73405 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.063760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.067441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f61d5e-7f7c-4a8a-830a-b9ad4bf73405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-04f61d5e-7f7c-4a8a-830a-b9ad4bf73405 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:02.075707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:02.081531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 89/167] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:02.083476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f61d5e-7f7c-4a8a-830a-b9ad4bf73405 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.147085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf688d2-6432-4d19-8f51-c8d302656e80 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.183144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de258ad3-421c-4f6c-830c-afdbc6a86129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.184053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258ad3-421c-4f6c-830c-afdbc6a86129 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.184340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258ad3-421c-4f6c-830c-afdbc6a86129 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.184617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258ad3-421c-4f6c-830c-afdbc6a86129 None admin] PATH_INFO: `/v3/users/d958fd8cfc2c470cb9932c3df1eae962` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.185831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de258ad3-421c-4f6c-830c-afdbc6a86129 None admin] RBAC: Authorizing `identity:get_user(user_id=d958fd8cfc2c470cb9932c3df1eae962)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.186294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f61d5e-7f7c-4a8a-830a-b9ad4bf73405 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.187276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de258ad3-421c-4f6c-830c-afdbc6a86129 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.189125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 79/168] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/users/d958fd8cfc2c470cb9932c3df1eae962 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:02.189809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de258ad3-421c-4f6c-830c-afdbc6a86129 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.223806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.224509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.224790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.225066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.225871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:02.226175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.227616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.236368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 90/169] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:02.237337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.264996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.297111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de258ad3-421c-4f6c-830c-afdbc6a86129 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.303188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.335746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.336448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.336775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.337060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.337864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:02.338176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.339565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.345800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8234ae4-7010-4886-925f-f3e4bfd93c9f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.348899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 80/170] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:02.349781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.381827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658ab55-96ff-4ef2-9600-df5b10329406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.382632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658ab55-96ff-4ef2-9600-df5b10329406 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.382964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658ab55-96ff-4ef2-9600-df5b10329406 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.383241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658ab55-96ff-4ef2-9600-df5b10329406 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.384699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658ab55-96ff-4ef2-9600-df5b10329406 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.386276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658ab55-96ff-4ef2-9600-df5b10329406 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.388105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 91/171] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:02.388749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658ab55-96ff-4ef2-9600-df5b10329406 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.458957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3fb55-de5b-42f1-867d-abcf9df4db5b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.493699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4b7d1-2b18-40d6-8f07-7984dc03a361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.494535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b7d1-2b18-40d6-8f07-7984dc03a361 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.494796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b7d1-2b18-40d6-8f07-7984dc03a361 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.495074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b7d1-2b18-40d6-8f07-7984dc03a361 None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.495357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658ab55-96ff-4ef2-9600-df5b10329406 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.496368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4b7d1-2b18-40d6-8f07-7984dc03a361 None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.497817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4b7d1-2b18-40d6-8f07-7984dc03a361 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.499474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 81/172] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:02.500356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4b7d1-2b18-40d6-8f07-7984dc03a361 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.505787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.527381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.533596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d5f21-5e1d-4aaf-af91-31df9c1725ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.534567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5f21-5e1d-4aaf-af91-31df9c1725ca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.534851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5f21-5e1d-4aaf-af91-31df9c1725ca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.535195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5f21-5e1d-4aaf-af91-31df9c1725ca None admin] PATH_INFO: `/v3/users/9c716bbf92114911b27d0d40a4830e1f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.536741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d5f21-5e1d-4aaf-af91-31df9c1725ca None admin] RBAC: Authorizing `identity:get_user(user_id=9c716bbf92114911b27d0d40a4830e1f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.538178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d5f21-5e1d-4aaf-af91-31df9c1725ca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.540232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 92/173] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/users/9c716bbf92114911b27d0d40a4830e1f => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:02.541174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d5f21-5e1d-4aaf-af91-31df9c1725ca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.604958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4b7d1-2b18-40d6-8f07-7984dc03a361 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.650503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9450-cd97-498d-9b86-48aff72bdd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.651398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9450-cd97-498d-9b86-48aff72bdd96 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.651678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9450-cd97-498d-9b86-48aff72bdd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.651971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9450-cd97-498d-9b86-48aff72bdd96 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7/users/d958fd8cfc2c470cb9932c3df1eae962/roles/e9ba98fdb77f4aadae316c27d3e158ae` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.654005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c9450-cd97-498d-9b86-48aff72bdd96 None admin] RBAC: Authorizing `identity:create_grant(project_id=dac392a9fac04fbea9237070eefab8d7, user_id=d958fd8cfc2c470cb9932c3df1eae962, role_id=e9ba98fdb77f4aadae316c27d3e158ae)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.655490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c9450-cd97-498d-9b86-48aff72bdd96 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.662244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d5f21-5e1d-4aaf-af91-31df9c1725ca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.724916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 82/174] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:02 2022] PUT /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7/users/d958fd8cfc2c470cb9932c3df1eae962/roles/e9ba98fdb77f4aadae316c27d3e158ae => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:02.726127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9450-cd97-498d-9b86-48aff72bdd96 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.736073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc7ba0-86a2-42b4-ba3d-d4e06b862627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.737050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc7ba0-86a2-42b4-ba3d-d4e06b862627 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.744003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc7ba0-86a2-42b4-ba3d-d4e06b862627 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.744003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc7ba0-86a2-42b4-ba3d-d4e06b862627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.820759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.824893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc7ba0-86a2-42b4-ba3d-d4e06b862627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.826371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc7ba0-86a2-42b4-ba3d-d4e06b862627 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.856323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.932556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9450-cd97-498d-9b86-48aff72bdd96 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.936268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 93/175] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:02.943755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc7ba0-86a2-42b4-ba3d-d4e06b862627 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.984485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637ccea-0fd1-4204-95f0-7b08992806d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.985145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637ccea-0fd1-4204-95f0-7b08992806d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.985425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637ccea-0fd1-4204-95f0-7b08992806d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.985699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637ccea-0fd1-4204-95f0-7b08992806d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:03.095888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637ccea-0fd1-4204-95f0-7b08992806d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:03.097498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637ccea-0fd1-4204-95f0-7b08992806d2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:03.129995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:03.134721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc7ba0-86a2-42b4-ba3d-d4e06b862627 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:03.182891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684b2c-1ca4-41c0-a03c-83720dc45fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:03.183578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:03.183757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684b2c-1ca4-41c0-a03c-83720dc45fcb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:03.184046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684b2c-1ca4-41c0-a03c-83720dc45fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:03.184321 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684b2c-1ca4-41c0-a03c-83720dc45fcb None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:03.186517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9684b2c-1ca4-41c0-a03c-83720dc45fcb None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:03.188080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9684b2c-1ca4-41c0-a03c-83720dc45fcb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:03.189976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 94/176] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:03.197001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684b2c-1ca4-41c0-a03c-83720dc45fcb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:03.263254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 83/177] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:03.269688 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637ccea-0fd1-4204-95f0-7b08992806d2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:03.430907 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684b2c-1ca4-41c0-a03c-83720dc45fcb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:03.466375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637ccea-0fd1-4204-95f0-7b08992806d2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:03.500306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:03.500970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:03.501250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:03.501523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:03.502354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] RBAC: Adding query filter params (role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=dac392a9fac04fbea9237070eefab8d7, user.id=9c716bbf92114911b27d0d40a4830e1f) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:03.502698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:03.504164 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:03.519701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 95/178] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:03 2022] GET /identity/v3/role_assignments?user.id=9c716bbf92114911b27d0d40a4830e1f&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:03.551136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51953a92-4fee-4fd0-ac87-62e166801c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:03.552056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953a92-4fee-4fd0-ac87-62e166801c54 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:03.552344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953a92-4fee-4fd0-ac87-62e166801c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:03.552619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51953a92-4fee-4fd0-ac87-62e166801c54 None admin] PATH_INFO: `/v3/projects/42ea3ff0d5e24e67ae6084863021fffb` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:03.553956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51953a92-4fee-4fd0-ac87-62e166801c54 None admin] RBAC: Authorizing `identity:get_project(project_id=42ea3ff0d5e24e67ae6084863021fffb)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:03.555404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51953a92-4fee-4fd0-ac87-62e166801c54 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:03.557444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 84/179] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:03 2022] GET /identity/v3/projects/42ea3ff0d5e24e67ae6084863021fffb => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:03.563303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:03.613861 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:03.706650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4e3e5-521b-4c1e-bb48-088d5b28b0e3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:03.758274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd92ca-bdff-461e-ab14-c4d4b63b3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:03.759272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd92ca-bdff-461e-ab14-c4d4b63b3066 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:03.759605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd92ca-bdff-461e-ab14-c4d4b63b3066 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:03.759884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd92ca-bdff-461e-ab14-c4d4b63b3066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:03.760806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd92ca-bdff-461e-ab14-c4d4b63b3066 None admin] RBAC: Adding query filter params (role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=42ea3ff0d5e24e67ae6084863021fffb, user.id=9c716bbf92114911b27d0d40a4830e1f) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:03.761122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd92ca-bdff-461e-ab14-c4d4b63b3066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:03.762586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd92ca-bdff-461e-ab14-c4d4b63b3066 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:03.771184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 96/180] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:03 2022] GET /identity/v3/role_assignments?user.id=9c716bbf92114911b27d0d40a4830e1f&scope.project.id=42ea3ff0d5e24e67ae6084863021fffb&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:04.518189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7aab2-3c9f-4e7e-af83-094c90631ad5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.518629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7aab2-3c9f-4e7e-af83-094c90631ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.518801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7aab2-3c9f-4e7e-af83-094c90631ad5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.520761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 85/181] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:04.526125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d625b-d5d3-40eb-a567-c90a5fd91514 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.527099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d625b-d5d3-40eb-a567-c90a5fd91514 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.527574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d625b-d5d3-40eb-a567-c90a5fd91514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.546722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cb8d625b-d5d3-40eb-a567-c90a5fd91514 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:04.548341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cb8d625b-d5d3-40eb-a567-c90a5fd91514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:04.580140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a43ab-4d4e-42cd-a6b4-81615ce5f7f0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.580638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a43ab-4d4e-42cd-a6b4-81615ce5f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.580711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a43ab-4d4e-42cd-a6b4-81615ce5f7f0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.582348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 86/182] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:04.588838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6269b6-cf55-4007-9de8-454787d32f95 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.589130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6269b6-cf55-4007-9de8-454787d32f95 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.589412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6269b6-cf55-4007-9de8-454787d32f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.614011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0a6269b6-cf55-4007-9de8-454787d32f95 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:04.615211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0a6269b6-cf55-4007-9de8-454787d32f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:04.630597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 97/183] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:04.643278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:04.653995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d625b-d5d3-40eb-a567-c90a5fd91514 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.683773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:04.696061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 87/184] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:04.727217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6269b6-cf55-4007-9de8-454787d32f95 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.779161 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d625b-d5d3-40eb-a567-c90a5fd91514 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:04.827056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed145c65-d35d-4784-a644-0f3904d54a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:04.828394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145c65-d35d-4784-a644-0f3904d54a19 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.828661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145c65-d35d-4784-a644-0f3904d54a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.828934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145c65-d35d-4784-a644-0f3904d54a19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.842108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed145c65-d35d-4784-a644-0f3904d54a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ed145c65-d35d-4784-a644-0f3904d54a19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:04.850327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:04.851186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:04.857133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 98/185] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:04.859216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed145c65-d35d-4784-a644-0f3904d54a19 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.874642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6269b6-cf55-4007-9de8-454787d32f95 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:04.912923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2127fa-dfb5-453d-bc24-72bec50abdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:04.913733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2127fa-dfb5-453d-bc24-72bec50abdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.914016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2127fa-dfb5-453d-bc24-72bec50abdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.914312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2127fa-dfb5-453d-bc24-72bec50abdf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.925628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2127fa-dfb5-453d-bc24-72bec50abdf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ee2127fa-dfb5-453d-bc24-72bec50abdf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:04.933767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:04.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:04.935506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 88/186] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:04.936200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdcc6f-3663-46a0-abd3-d9861ec9ee87 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.941243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdcc6f-3663-46a0-abd3-d9861ec9ee87 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.941243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdcc6f-3663-46a0-abd3-d9861ec9ee87 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.941243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 89/187] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:04.945287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdcc6f-3663-46a0-abd3-d9861ec9ee87 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.958498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:04.967672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:04.974879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed145c65-d35d-4784-a644-0f3904d54a19 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.009968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11cde4-66a5-4ad2-89b7-8aaa78da4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.011041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11cde4-66a5-4ad2-89b7-8aaa78da4397 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.011475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11cde4-66a5-4ad2-89b7-8aaa78da4397 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.012000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11cde4-66a5-4ad2-89b7-8aaa78da4397 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.012928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11cde4-66a5-4ad2-89b7-8aaa78da4397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:05.013455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11cde4-66a5-4ad2-89b7-8aaa78da4397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.015153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11cde4-66a5-4ad2-89b7-8aaa78da4397 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.024675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 99/188] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:05.026068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387354b1-e2b6-4ec1-9a34-8622fa5a3dc0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.026360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387354b1-e2b6-4ec1-9a34-8622fa5a3dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.026639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387354b1-e2b6-4ec1-9a34-8622fa5a3dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.044693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-387354b1-e2b6-4ec1-9a34-8622fa5a3dc0 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:05.045961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-387354b1-e2b6-4ec1-9a34-8622fa5a3dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:05.060414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdcc6f-3663-46a0-abd3-d9861ec9ee87 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.097141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.097810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.098113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.098359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.099104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:05.099408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.100826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.109346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 90/189] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.113970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.120791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 100/190] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:05.121670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387354b1-e2b6-4ec1-9a34-8622fa5a3dc0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.203538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.214031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.223023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d6719-ddb4-4a2c-bb98-8cc83a24ccda None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.238458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387354b1-e2b6-4ec1-9a34-8622fa5a3dc0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.258452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6e7ed-748e-4487-9cbf-6c0fc550adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.259961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e7ed-748e-4487-9cbf-6c0fc550adf0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.260448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e7ed-748e-4487-9cbf-6c0fc550adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.260874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e7ed-748e-4487-9cbf-6c0fc550adf0 None admin] PATH_INFO: `/v3/users/e580a1e7afb547d79ad679db265e73f0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.272652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920236f-4331-4c64-b75c-fa5ffc127d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.273589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920236f-4331-4c64-b75c-fa5ffc127d1e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.273874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920236f-4331-4c64-b75c-fa5ffc127d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.274150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920236f-4331-4c64-b75c-fa5ffc127d1e None admin] PATH_INFO: `/v3/users/e580a1e7afb547d79ad679db265e73f0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.276314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6e7ed-748e-4487-9cbf-6c0fc550adf0 None admin] RBAC: Authorizing `identity:get_user(user_id=e580a1e7afb547d79ad679db265e73f0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.277978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6e7ed-748e-4487-9cbf-6c0fc550adf0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.280180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 91/191] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/users/e580a1e7afb547d79ad679db265e73f0 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.281134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6e7ed-748e-4487-9cbf-6c0fc550adf0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.291405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920236f-4331-4c64-b75c-fa5ffc127d1e None admin] RBAC: Authorizing `identity:get_user(user_id=e580a1e7afb547d79ad679db265e73f0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.292906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920236f-4331-4c64-b75c-fa5ffc127d1e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.294618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 101/192] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/users/e580a1e7afb547d79ad679db265e73f0 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.295505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920236f-4331-4c64-b75c-fa5ffc127d1e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.397195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920236f-4331-4c64-b75c-fa5ffc127d1e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.397745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6e7ed-748e-4487-9cbf-6c0fc550adf0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.434179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efce186-ef6e-4a25-ade8-9d6b6886771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.434379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe4103-e8b8-47d9-92ee-97c694ab740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.435020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4103-e8b8-47d9-92ee-97c694ab740c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.435301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4103-e8b8-47d9-92ee-97c694ab740c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.435574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe4103-e8b8-47d9-92ee-97c694ab740c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.435947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce186-ef6e-4a25-ade8-9d6b6886771d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.436390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce186-ef6e-4a25-ade8-9d6b6886771d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.436821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efce186-ef6e-4a25-ade8-9d6b6886771d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.438222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.438605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efce186-ef6e-4a25-ade8-9d6b6886771d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.440596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efce186-ef6e-4a25-ade8-9d6b6886771d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.442388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 92/193] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.443301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efce186-ef6e-4a25-ade8-9d6b6886771d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.457701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.503721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe4103-e8b8-47d9-92ee-97c694ab740c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.505219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe4103-e8b8-47d9-92ee-97c694ab740c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.544306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efce186-ef6e-4a25-ade8-9d6b6886771d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.577349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8fb2d-776b-4df6-8732-5e84cc0ff4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.578170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8fb2d-776b-4df6-8732-5e84cc0ff4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.578495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8fb2d-776b-4df6-8732-5e84cc0ff4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.578770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8fb2d-776b-4df6-8732-5e84cc0ff4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.601422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 102/194] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:05.602729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7f98-d951-4c69-a092-cfbc1d155a95 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.603015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7f98-d951-4c69-a092-cfbc1d155a95 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.603292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7f98-d951-4c69-a092-cfbc1d155a95 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.604584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 103/195] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:05.605265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7f98-d951-4c69-a092-cfbc1d155a95 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.640824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.651210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8fb2d-776b-4df6-8732-5e84cc0ff4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.652697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8fb2d-776b-4df6-8732-5e84cc0ff4c7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.662180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.704660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7f98-d951-4c69-a092-cfbc1d155a95 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.739501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669eef7-d895-4ba8-bac4-989619633fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.740199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669eef7-d895-4ba8-bac4-989619633fa0 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.740479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669eef7-d895-4ba8-bac4-989619633fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.740754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669eef7-d895-4ba8-bac4-989619633fa0 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.741464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669eef7-d895-4ba8-bac4-989619633fa0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.742904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669eef7-d895-4ba8-bac4-989619633fa0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.751834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 93/196] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:05.752788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8fb2d-776b-4df6-8732-5e84cc0ff4c7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.843343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 104/197] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:05 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:05.850459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8fb2d-776b-4df6-8732-5e84cc0ff4c7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.861244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.861494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf76227-3025-4be8-9745-5c2352565eac None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.861787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf76227-3025-4be8-9745-5c2352565eac None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.862654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf76227-3025-4be8-9745-5c2352565eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.884224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ecf76227-3025-4be8-9745-5c2352565eac None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:05.886191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ecf76227-3025-4be8-9745-5c2352565eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:05.889252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc1fcb-e875-4d31-91ab-659bdfdb0bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.890140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1fcb-e875-4d31-91ab-659bdfdb0bad None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.890406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1fcb-e875-4d31-91ab-659bdfdb0bad None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.890677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc1fcb-e875-4d31-91ab-659bdfdb0bad None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.891965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc1fcb-e875-4d31-91ab-659bdfdb0bad None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.893489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc1fcb-e875-4d31-91ab-659bdfdb0bad None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.895256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 94/198] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.901962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc1fcb-e875-4d31-91ab-659bdfdb0bad None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.969216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 105/199] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:05.970094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf76227-3025-4be8-9745-5c2352565eac None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.995449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.029002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc1fcb-e875-4d31-91ab-659bdfdb0bad None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.071297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7da37-c35f-4777-9430-194ed2626cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.072192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7da37-c35f-4777-9430-194ed2626cac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.072472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7da37-c35f-4777-9430-194ed2626cac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.072743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7da37-c35f-4777-9430-194ed2626cac None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.073957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7da37-c35f-4777-9430-194ed2626cac None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.075946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7da37-c35f-4777-9430-194ed2626cac None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.078816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 95/200] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:06.078816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7da37-c35f-4777-9430-194ed2626cac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.090759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf76227-3025-4be8-9745-5c2352565eac None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.129092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.129674 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.129951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.130263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.131175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=d21689e5ee72418fa4d0466bd95317f4, user.id=e580a1e7afb547d79ad679db265e73f0) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:06.131489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.132983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.139341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.140287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 106/201] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/role_assignments?user.id=e580a1e7afb547d79ad679db265e73f0&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:06.141100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.225286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7da37-c35f-4777-9430-194ed2626cac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.244540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.262277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f11c21-fa88-410c-92ff-a7e171ea9b7f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.285418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa79eeb-77a8-461f-9022-6cda2bc559be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.286256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa79eeb-77a8-461f-9022-6cda2bc559be None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.286544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa79eeb-77a8-461f-9022-6cda2bc559be None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.286825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa79eeb-77a8-461f-9022-6cda2bc559be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.314651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.315540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.315834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.316145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.316677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa79eeb-77a8-461f-9022-6cda2bc559be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:06.317043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] RBAC: Adding query filter params (role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=d21689e5ee72418fa4d0466bd95317f4, user.id=e580a1e7afb547d79ad679db265e73f0) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:06.317365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.318820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.331941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 107/202] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/role_assignments?user.id=e580a1e7afb547d79ad679db265e73f0&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-dfa79eeb-77a8-461f-9022-6cda2bc559be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:06.332233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:06.333085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:06.333859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 96/203] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:06.335375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.490549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1725d6-efee-4707-8e0e-916c5db24842 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.543511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.544220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.544504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.544782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.545545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:06.545855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.547260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.557099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 108/204] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:06.562325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa79eeb-77a8-461f-9022-6cda2bc559be None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.669408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa79eeb-77a8-461f-9022-6cda2bc559be None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.671772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.705480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b376-b458-4c8c-b1a8-87449939cb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.706391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b376-b458-4c8c-b1a8-87449939cb61 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.706681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b376-b458-4c8c-b1a8-87449939cb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.707161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b376-b458-4c8c-b1a8-87449939cb61 None admin] PATH_INFO: `/v3/users/d958fd8cfc2c470cb9932c3df1eae962` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.708536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3b376-b458-4c8c-b1a8-87449939cb61 None admin] RBAC: Authorizing `identity:get_user(user_id=d958fd8cfc2c470cb9932c3df1eae962)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.710053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3b376-b458-4c8c-b1a8-87449939cb61 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.712120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 97/205] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/users/d958fd8cfc2c470cb9932c3df1eae962 => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:06.717743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.743117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.867824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b75561-24b2-4d87-955d-5686a602eedd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.906605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb6db8-7c99-4425-bb4c-a550f42c3022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.907261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6db8-7c99-4425-bb4c-a550f42c3022 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.907545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6db8-7c99-4425-bb4c-a550f42c3022 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.907829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6db8-7c99-4425-bb4c-a550f42c3022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.003358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb6db8-7c99-4425-bb4c-a550f42c3022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.004782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb6db8-7c99-4425-bb4c-a550f42c3022 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.019004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.137920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 109/206] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:07.144083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b376-b458-4c8c-b1a8-87449939cb61 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.269629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b376-b458-4c8c-b1a8-87449939cb61 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.304056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e2829-3c94-440f-8f61-6df2255a13de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.304923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2829-3c94-440f-8f61-6df2255a13de None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.305208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2829-3c94-440f-8f61-6df2255a13de None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.305489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e2829-3c94-440f-8f61-6df2255a13de None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.306691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e2829-3c94-440f-8f61-6df2255a13de None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.308171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e2829-3c94-440f-8f61-6df2255a13de None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.310165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 98/207] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:07.316252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb6db8-7c99-4425-bb4c-a550f42c3022 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.440123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb6db8-7c99-4425-bb4c-a550f42c3022 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.451627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.489600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24b434-b64d-4138-8bc4-27fe4581fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.490267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b434-b64d-4138-8bc4-27fe4581fdbf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.490554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b434-b64d-4138-8bc4-27fe4581fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.490836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b434-b64d-4138-8bc4-27fe4581fdbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.491672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24b434-b64d-4138-8bc4-27fe4581fdbf None admin] RBAC: Adding query filter params (role.id=e9ba98fdb77f4aadae316c27d3e158ae, scope.project.id=dac392a9fac04fbea9237070eefab8d7, user.id=d958fd8cfc2c470cb9932c3df1eae962) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:07.492010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24b434-b64d-4138-8bc4-27fe4581fdbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.493461 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24b434-b64d-4138-8bc4-27fe4581fdbf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.502373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 110/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/role_assignments?user.id=d958fd8cfc2c470cb9932c3df1eae962&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=e9ba98fdb77f4aadae316c27d3e158ae => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:08.479356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e093-67a2-4508-a652-33f705dc83ac None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.479356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e093-67a2-4508-a652-33f705dc83ac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.479356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e093-67a2-4508-a652-33f705dc83ac None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.480712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 99/209] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:08.487585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6ab4-aaa6-4abc-ac6a-d2c5f5467fc3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.488579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6ab4-aaa6-4abc-ac6a-d2c5f5467fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.489080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6ab4-aaa6-4abc-ac6a-d2c5f5467fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.507830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-43ae6ab4-aaa6-4abc-ac6a-d2c5f5467fc3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:08.509673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-43ae6ab4-aaa6-4abc-ac6a-d2c5f5467fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:08.554196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d21dc-2f64-4bf1-97d6-362e6fbcd45c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.554814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d21dc-2f64-4bf1-97d6-362e6fbcd45c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.555317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d21dc-2f64-4bf1-97d6-362e6fbcd45c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.557146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 100/210] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:08.562342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793347a9-9b0f-43dc-8d6f-115e232cd942 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.562840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793347a9-9b0f-43dc-8d6f-115e232cd942 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.563317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793347a9-9b0f-43dc-8d6f-115e232cd942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.578671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 111/211] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:08.580983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-793347a9-9b0f-43dc-8d6f-115e232cd942 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:08.582368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-793347a9-9b0f-43dc-8d6f-115e232cd942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:08.602917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6ab4-aaa6-4abc-ac6a-d2c5f5467fc3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.620356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.658753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 101/212] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:08.684751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793347a9-9b0f-43dc-8d6f-115e232cd942 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.706633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6ab4-aaa6-4abc-ac6a-d2c5f5467fc3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.709296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.746251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133429-57a0-4c19-82d3-7c9f038a16f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.747946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133429-57a0-4c19-82d3-7c9f038a16f6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.748400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133429-57a0-4c19-82d3-7c9f038a16f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.748817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133429-57a0-4c19-82d3-7c9f038a16f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.750456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9133429-57a0-4c19-82d3-7c9f038a16f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.753598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9133429-57a0-4c19-82d3-7c9f038a16f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.761958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 112/213] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:08.764013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133429-57a0-4c19-82d3-7c9f038a16f6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.823061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793347a9-9b0f-43dc-8d6f-115e232cd942 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.861304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aa314-e84a-4b8c-a000-78d3e2ed949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.862600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aa314-e84a-4b8c-a000-78d3e2ed949d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.862873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aa314-e84a-4b8c-a000-78d3e2ed949d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.863142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aa314-e84a-4b8c-a000-78d3e2ed949d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.872853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7aa314-e84a-4b8c-a000-78d3e2ed949d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5a7aa314-e84a-4b8c-a000-78d3e2ed949d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:08.881075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:08.881982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:08.882766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:08.883496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133429-57a0-4c19-82d3-7c9f038a16f6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.883849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 102/214] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:08.883849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdaf88-4b5a-4b41-8534-a8559aadebb7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.884015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdaf88-4b5a-4b41-8534-a8559aadebb7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.884230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdaf88-4b5a-4b41-8534-a8559aadebb7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.885635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 103/215] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:08.886499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce09b-fb26-471e-b4f4-9bb30fd625be None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.886783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce09b-fb26-471e-b4f4-9bb30fd625be None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.887044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ce09b-fb26-471e-b4f4-9bb30fd625be None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.888400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 104/216] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:08.889208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ce09b-fb26-471e-b4f4-9bb30fd625be None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.918892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92372dde-f6b6-437d-9d18-dd24ec6c2a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.919231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.919557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372dde-f6b6-437d-9d18-dd24ec6c2a90 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.919841 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372dde-f6b6-437d-9d18-dd24ec6c2a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.920155 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372dde-f6b6-437d-9d18-dd24ec6c2a90 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.920860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92372dde-f6b6-437d-9d18-dd24ec6c2a90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.922301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92372dde-f6b6-437d-9d18-dd24ec6c2a90 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.993282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ce09b-fb26-471e-b4f4-9bb30fd625be None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.026116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c23e-1c5d-4906-974a-07af4ec5f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.026775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c23e-1c5d-4906-974a-07af4ec5f33d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.027057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c23e-1c5d-4906-974a-07af4ec5f33d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.027336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c23e-1c5d-4906-974a-07af4ec5f33d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.028101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7c23e-1c5d-4906-974a-07af4ec5f33d None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.028409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7c23e-1c5d-4906-974a-07af4ec5f33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.029766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7c23e-1c5d-4906-974a-07af4ec5f33d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.037756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 113/217] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:08 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:09.044379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 105/218] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.044482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868301-2178-495a-8024-3e6d865cadee None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.044482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868301-2178-495a-8024-3e6d865cadee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.044607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898c03-7dd7-4f1e-ac41-18fce4607bc7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.044672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868301-2178-495a-8024-3e6d865cadee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.044750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898c03-7dd7-4f1e-ac41-18fce4607bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.044750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40898c03-7dd7-4f1e-ac41-18fce4607bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.061543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9f868301-2178-495a-8024-3e6d865cadee None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:09.063086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9f868301-2178-495a-8024-3e6d865cadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:09.066567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-40898c03-7dd7-4f1e-ac41-18fce4607bc7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:09.067932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-40898c03-7dd7-4f1e-ac41-18fce4607bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:09.088732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.137883 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 114/219] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:09.145083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f868301-2178-495a-8024-3e6d865cadee None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.155793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 106/220] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:09.163609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40898c03-7dd7-4f1e-ac41-18fce4607bc7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.193424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.255667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f868301-2178-495a-8024-3e6d865cadee None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.279944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40898c03-7dd7-4f1e-ac41-18fce4607bc7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.297984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96343ac-c18c-4de7-aeec-e1b45572a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.299139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96343ac-c18c-4de7-aeec-e1b45572a080 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.300214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96343ac-c18c-4de7-aeec-e1b45572a080 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.300634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96343ac-c18c-4de7-aeec-e1b45572a080 None admin] PATH_INFO: `/v3/users/1cb1d92bccdd4296ba8cb141856bc29a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.316455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96343ac-c18c-4de7-aeec-e1b45572a080 None admin] RBAC: Authorizing `identity:get_user(user_id=1cb1d92bccdd4296ba8cb141856bc29a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.318451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96343ac-c18c-4de7-aeec-e1b45572a080 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.320361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 115/221] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/users/1cb1d92bccdd4296ba8cb141856bc29a => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.321368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96343ac-c18c-4de7-aeec-e1b45572a080 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.322992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7590d9-47b2-4b35-8e52-273677c3ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.323845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7590d9-47b2-4b35-8e52-273677c3ad79 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.324161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7590d9-47b2-4b35-8e52-273677c3ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.324468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7590d9-47b2-4b35-8e52-273677c3ad79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.336475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7590d9-47b2-4b35-8e52-273677c3ad79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:09.342047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9d7590d9-47b2-4b35-8e52-273677c3ad79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:09.344275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:09.345128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:09.345888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 107/222] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:09.347056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7590d9-47b2-4b35-8e52-273677c3ad79 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.446669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96343ac-c18c-4de7-aeec-e1b45572a080 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.447089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.473395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7590d9-47b2-4b35-8e52-273677c3ad79 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.485729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffd74f-55a9-4a93-8503-57b3b49cb9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.486765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd74f-55a9-4a93-8503-57b3b49cb9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.487140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd74f-55a9-4a93-8503-57b3b49cb9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.487480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd74f-55a9-4a93-8503-57b3b49cb9d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.498540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffd74f-55a9-4a93-8503-57b3b49cb9d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-53ffd74f-55a9-4a93-8503-57b3b49cb9d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:09.506871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:09.507953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:09.509200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:09.510760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 116/223] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:09.511681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffd74f-55a9-4a93-8503-57b3b49cb9d2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.520639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b470f32-f3ad-4ba1-8b31-26fb88f481c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.521816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470f32-f3ad-4ba1-8b31-26fb88f481c9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.522798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470f32-f3ad-4ba1-8b31-26fb88f481c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.523218 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470f32-f3ad-4ba1-8b31-26fb88f481c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.607307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b470f32-f3ad-4ba1-8b31-26fb88f481c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.609523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b470f32-f3ad-4ba1-8b31-26fb88f481c9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.610410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.634456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffd74f-55a9-4a93-8503-57b3b49cb9d2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.672940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.673756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.674160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.675068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.675888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.676285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.677741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.687974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 117/224] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.687974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.716836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.737883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 108/225] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:09.739068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b470f32-f3ad-4ba1-8b31-26fb88f481c9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.822038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634560-d12b-4e51-8b96-8f577ff8a3b5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.852044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b470f32-f3ad-4ba1-8b31-26fb88f481c9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.858716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.859435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.859828 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.860139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.860894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.861200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.863256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.868871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.874032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 118/226] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.874908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.889097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652447ab-945e-4550-b5c7-9700cdbc5c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.889973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652447ab-945e-4550-b5c7-9700cdbc5c37 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.890251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652447ab-945e-4550-b5c7-9700cdbc5c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.890526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652447ab-945e-4550-b5c7-9700cdbc5c37 None admin] PATH_INFO: `/v3/users/e580a1e7afb547d79ad679db265e73f0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.891722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652447ab-945e-4550-b5c7-9700cdbc5c37 None admin] RBAC: Authorizing `identity:get_user(user_id=e580a1e7afb547d79ad679db265e73f0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.893880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652447ab-945e-4550-b5c7-9700cdbc5c37 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.895741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 109/227] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/users/e580a1e7afb547d79ad679db265e73f0 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.899841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652447ab-945e-4550-b5c7-9700cdbc5c37 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.952606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.985850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b02ca6-8a30-4c1c-837f-66abc426d120 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.007795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652447ab-945e-4550-b5c7-9700cdbc5c37 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.023390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcfcbc-aa76-4f48-8737-7216d9c7a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.024354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfcbc-aa76-4f48-8737-7216d9c7a799 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.024637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfcbc-aa76-4f48-8737-7216d9c7a799 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.024912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfcbc-aa76-4f48-8737-7216d9c7a799 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.026176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcfcbc-aa76-4f48-8737-7216d9c7a799 None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.027583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcfcbc-aa76-4f48-8737-7216d9c7a799 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.029748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 119/228] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:10.030520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcfcbc-aa76-4f48-8737-7216d9c7a799 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.050347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130106a-6a7c-4bf9-bdd4-13b283c44fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.051228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130106a-6a7c-4bf9-bdd4-13b283c44fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.051506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130106a-6a7c-4bf9-bdd4-13b283c44fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.051774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130106a-6a7c-4bf9-bdd4-13b283c44fd4 None admin] PATH_INFO: `/v3/users/e580a1e7afb547d79ad679db265e73f0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.052994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130106a-6a7c-4bf9-bdd4-13b283c44fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=e580a1e7afb547d79ad679db265e73f0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.054540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130106a-6a7c-4bf9-bdd4-13b283c44fd4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.056187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 110/229] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/users/e580a1e7afb547d79ad679db265e73f0 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:10.057095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130106a-6a7c-4bf9-bdd4-13b283c44fd4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.104439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:10.139215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcfcbc-aa76-4f48-8737-7216d9c7a799 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.160857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130106a-6a7c-4bf9-bdd4-13b283c44fd4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.175427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce79d97-31c3-4062-ab5e-a4e975f4f53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.176305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce79d97-31c3-4062-ab5e-a4e975f4f53f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.176582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce79d97-31c3-4062-ab5e-a4e975f4f53f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.176851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce79d97-31c3-4062-ab5e-a4e975f4f53f None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.178029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce79d97-31c3-4062-ab5e-a4e975f4f53f None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.178898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:10.179465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce79d97-31c3-4062-ab5e-a4e975f4f53f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.181185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 120/230] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:10 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:10.182028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce79d97-31c3-4062-ab5e-a4e975f4f53f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.202729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.203639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.203939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.204247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.205231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] RBAC: Adding query filter params (role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=d21689e5ee72418fa4d0466bd95317f4, user.id=1cb1d92bccdd4296ba8cb141856bc29a) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:10.206339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.207777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.220070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 111/231] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:10 2022] GET /identity/v3/role_assignments?user.id=1cb1d92bccdd4296ba8cb141856bc29a&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:10.220958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.371255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce79d97-31c3-4062-ab5e-a4e975f4f53f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.425654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b64f44-17c3-4381-99c3-657f78d5de62 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.437470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487ec9b-d75e-4c4f-a143-d04fa99b7136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.438439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487ec9b-d75e-4c4f-a143-d04fa99b7136 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.438723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487ec9b-d75e-4c4f-a143-d04fa99b7136 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.438991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487ec9b-d75e-4c4f-a143-d04fa99b7136 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.441724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487ec9b-d75e-4c4f-a143-d04fa99b7136 None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.443282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487ec9b-d75e-4c4f-a143-d04fa99b7136 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.445412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 121/232] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:10 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:10.450465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487ec9b-d75e-4c4f-a143-d04fa99b7136 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.456394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:10.466897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1a31-e38e-46b6-9c67-0d0fc84d1e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.467782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1a31-e38e-46b6-9c67-0d0fc84d1e72 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.468116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1a31-e38e-46b6-9c67-0d0fc84d1e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.468409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1a31-e38e-46b6-9c67-0d0fc84d1e72 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4/users/e580a1e7afb547d79ad679db265e73f0/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.472043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1a31-e38e-46b6-9c67-0d0fc84d1e72 None admin] RBAC: Authorizing `identity:create_grant(project_id=d21689e5ee72418fa4d0466bd95317f4, user_id=e580a1e7afb547d79ad679db265e73f0, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.473503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1a31-e38e-46b6-9c67-0d0fc84d1e72 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.563936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487ec9b-d75e-4c4f-a143-d04fa99b7136 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.588532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 112/233] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:10 2022] PUT /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4/users/e580a1e7afb547d79ad679db265e73f0/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:10.615720 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5d858-e5ec-4d83-ba48-4584966de403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.616736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5d858-e5ec-4d83-ba48-4584966de403 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.617025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5d858-e5ec-4d83-ba48-4584966de403 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.617301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5d858-e5ec-4d83-ba48-4584966de403 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4/users/e580a1e7afb547d79ad679db265e73f0/roles/414930bf02ef4277b0b66bc57f1f1628` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.619673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5d858-e5ec-4d83-ba48-4584966de403 None admin] RBAC: Authorizing `identity:create_grant(project_id=d21689e5ee72418fa4d0466bd95317f4, user_id=e580a1e7afb547d79ad679db265e73f0, role_id=414930bf02ef4277b0b66bc57f1f1628)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.621216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5d858-e5ec-4d83-ba48-4584966de403 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.714672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 122/234] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:10 2022] PUT /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4/users/e580a1e7afb547d79ad679db265e73f0/roles/414930bf02ef4277b0b66bc57f1f1628 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:22:11.462388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41bbf7-bcec-4a5b-b1e7-a6744d16fbc9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.462797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41bbf7-bcec-4a5b-b1e7-a6744d16fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.462967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41bbf7-bcec-4a5b-b1e7-a6744d16fbc9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.464544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 113/235] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:11.477410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ee94-ea3d-4be2-b598-9a0ec74e88b1 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.477682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ee94-ea3d-4be2-b598-9a0ec74e88b1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.477965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09ee94-ea3d-4be2-b598-9a0ec74e88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.486664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33762-1b1a-4b9a-8409-28ae399cfb08 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.487496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33762-1b1a-4b9a-8409-28ae399cfb08 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.487781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33762-1b1a-4b9a-8409-28ae399cfb08 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.489431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 114/236] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:11.494438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf77d1-846f-4c05-8831-7a93f54d2f23 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.494720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf77d1-846f-4c05-8831-7a93f54d2f23 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.494994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf77d1-846f-4c05-8831-7a93f54d2f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.499767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bb09ee94-ea3d-4be2-b598-9a0ec74e88b1 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:11.501001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bb09ee94-ea3d-4be2-b598-9a0ec74e88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:11.512312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cfcf77d1-846f-4c05-8831-7a93f54d2f23 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:11.513564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cfcf77d1-846f-4c05-8831-7a93f54d2f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:11.569797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.580207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.591156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 123/237] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:11.621041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09ee94-ea3d-4be2-b598-9a0ec74e88b1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.640234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 115/238] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:11.679434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf77d1-846f-4c05-8831-7a93f54d2f23 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.813113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf77d1-846f-4c05-8831-7a93f54d2f23 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.836979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09ee94-ea3d-4be2-b598-9a0ec74e88b1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.880109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd24c9-1d51-4385-97b6-f302671c0b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.881292 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd24c9-1d51-4385-97b6-f302671c0b8f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.882476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd24c9-1d51-4385-97b6-f302671c0b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.882953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd24c9-1d51-4385-97b6-f302671c0b8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.900629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd24c9-1d51-4385-97b6-f302671c0b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-dfdd24c9-1d51-4385-97b6-f302671c0b8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:11.909563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:11.910410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:11.911191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:11.914690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c52a3-90a2-438a-adcd-6b8267e23b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.915704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c52a3-90a2-438a-adcd-6b8267e23b17 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.916206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c52a3-90a2-438a-adcd-6b8267e23b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.916691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c52a3-90a2-438a-adcd-6b8267e23b17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.918062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c52a3-90a2-438a-adcd-6b8267e23b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:11.919723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c52a3-90a2-438a-adcd-6b8267e23b17 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:11.921572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 124/239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:11.923169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 116/240] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:11.928837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c52a3-90a2-438a-adcd-6b8267e23b17 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.930566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd24c9-1d51-4385-97b6-f302671c0b8f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.973097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.060247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.106279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd24c9-1d51-4385-97b6-f302671c0b8f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.154335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.155003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.155286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.155559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.156340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:12.156646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.158054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.162169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c52a3-90a2-438a-adcd-6b8267e23b17 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.182872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 117/241] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:12.188809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.232538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335da0f-4109-4b2d-abe8-70a722456767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.233218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335da0f-4109-4b2d-abe8-70a722456767 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.233498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335da0f-4109-4b2d-abe8-70a722456767 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.233765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335da0f-4109-4b2d-abe8-70a722456767 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.234481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335da0f-4109-4b2d-abe8-70a722456767 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.235938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335da0f-4109-4b2d-abe8-70a722456767 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.324645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.331432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4e994-50df-4176-bad7-f81bf506868f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.365874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212985f1-0cf1-41d9-888e-05a3bf601e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.366803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212985f1-0cf1-41d9-888e-05a3bf601e42 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.367089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212985f1-0cf1-41d9-888e-05a3bf601e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.367364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212985f1-0cf1-41d9-888e-05a3bf601e42 None admin] PATH_INFO: `/v3/users/bffeadac0c9246d1b376eb97cbea0198` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.385521 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 125/242] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:11 2022] POST /identity/v3/users => generated 293 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:12.388899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212985f1-0cf1-41d9-888e-05a3bf601e42 None admin] RBAC: Authorizing `identity:get_user(user_id=bffeadac0c9246d1b376eb97cbea0198)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.390428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212985f1-0cf1-41d9-888e-05a3bf601e42 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.392458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 118/243] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/users/bffeadac0c9246d1b376eb97cbea0198 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:12.397874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335da0f-4109-4b2d-abe8-70a722456767 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.528721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335da0f-4109-4b2d-abe8-70a722456767 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.547593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.581578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd5344-bf70-435f-a6f6-3d2168f9ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.582191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd5344-bf70-435f-a6f6-3d2168f9ccfd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.582495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd5344-bf70-435f-a6f6-3d2168f9ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.582790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd5344-bf70-435f-a6f6-3d2168f9ccfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.671840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd5344-bf70-435f-a6f6-3d2168f9ccfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.673323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd5344-bf70-435f-a6f6-3d2168f9ccfd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.771440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505cd5-4d6e-4483-8129-d5d3119c2e57 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.772006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505cd5-4d6e-4483-8129-d5d3119c2e57 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.772006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505cd5-4d6e-4483-8129-d5d3119c2e57 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.773367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 119/244] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:12.778799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697969b-c5d0-46e4-81ae-7fcae88bf119 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.779216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697969b-c5d0-46e4-81ae-7fcae88bf119 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.779601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697969b-c5d0-46e4-81ae-7fcae88bf119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.797276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b697969b-c5d0-46e4-81ae-7fcae88bf119 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:12.798624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b697969b-c5d0-46e4-81ae-7fcae88bf119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:12.830188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 126/245] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:12.838175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd5344-bf70-435f-a6f6-3d2168f9ccfd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.863820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.891539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 120/246] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:12.921132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697969b-c5d0-46e4-81ae-7fcae88bf119 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.972362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd5344-bf70-435f-a6f6-3d2168f9ccfd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.017648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a558d2-c97e-47eb-bd36-eccb9774b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.019455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a558d2-c97e-47eb-bd36-eccb9774b16e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.024945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a558d2-c97e-47eb-bd36-eccb9774b16e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.024945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a558d2-c97e-47eb-bd36-eccb9774b16e None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.024945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a558d2-c97e-47eb-bd36-eccb9774b16e None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.025603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a558d2-c97e-47eb-bd36-eccb9774b16e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.028124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 127/247] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:13.034248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.035238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a558d2-c97e-47eb-bd36-eccb9774b16e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.061178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697969b-c5d0-46e4-81ae-7fcae88bf119 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.107007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06fd52-4676-4e18-9894-905a81e0ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.108221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06fd52-4676-4e18-9894-905a81e0ad2f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.108794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06fd52-4676-4e18-9894-905a81e0ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.109268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06fd52-4676-4e18-9894-905a81e0ad2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.121831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06fd52-4676-4e18-9894-905a81e0ad2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2e06fd52-4676-4e18-9894-905a81e0ad2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:13.132024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:13.132964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:13.133999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:13.140114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.147483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 121/248] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:13.149420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06fd52-4676-4e18-9894-905a81e0ad2f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.160324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a558d2-c97e-47eb-bd36-eccb9774b16e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.213515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60951597-8b02-4011-8e2b-ca8755b8419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.214234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951597-8b02-4011-8e2b-ca8755b8419d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.214521 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951597-8b02-4011-8e2b-ca8755b8419d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.214786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60951597-8b02-4011-8e2b-ca8755b8419d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.215630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60951597-8b02-4011-8e2b-ca8755b8419d None admin] RBAC: Adding query filter params (role.id=e9ba98fdb77f4aadae316c27d3e158ae, scope.project.id=d21689e5ee72418fa4d0466bd95317f4, user.id=bffeadac0c9246d1b376eb97cbea0198) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:13.215965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60951597-8b02-4011-8e2b-ca8755b8419d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.217433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60951597-8b02-4011-8e2b-ca8755b8419d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.226539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 128/249] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/role_assignments?user.id=bffeadac0c9246d1b376eb97cbea0198&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=e9ba98fdb77f4aadae316c27d3e158ae => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:13.228423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0e71-d606-469b-bc28-012b9e4ff648 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.228938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0e71-d606-469b-bc28-012b9e4ff648 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.229417 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e0e71-d606-469b-bc28-012b9e4ff648 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.231402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 129/250] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:13.238144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a8459-4f3d-4fdc-9cc6-52ffb1030a27 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.238796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a8459-4f3d-4fdc-9cc6-52ffb1030a27 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.239294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a8459-4f3d-4fdc-9cc6-52ffb1030a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.266585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3d7a8459-4f3d-4fdc-9cc6-52ffb1030a27 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:13.269565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3d7a8459-4f3d-4fdc-9cc6-52ffb1030a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:13.305181 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06fd52-4676-4e18-9894-905a81e0ad2f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.352645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717913e-8cd0-4be4-b5ee-16e0a348bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.353736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717913e-8cd0-4be4-b5ee-16e0a348bf1b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.354384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717913e-8cd0-4be4-b5ee-16e0a348bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.355305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717913e-8cd0-4be4-b5ee-16e0a348bf1b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.356657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717913e-8cd0-4be4-b5ee-16e0a348bf1b None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:13.357392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717913e-8cd0-4be4-b5ee-16e0a348bf1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.359770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717913e-8cd0-4be4-b5ee-16e0a348bf1b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.367976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 130/251] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:13.369379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7609-7676-4854-8812-169637c76269 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.369661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7609-7676-4854-8812-169637c76269 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.369932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7609-7676-4854-8812-169637c76269 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.376358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 131/253] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:13.380348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 122/253] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:13.381309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b7609-7676-4854-8812-169637c76269 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.382849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba253-e75f-4153-8eab-02fc9abe8980 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.383141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba253-e75f-4153-8eab-02fc9abe8980 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.383421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba253-e75f-4153-8eab-02fc9abe8980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.408073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.426655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3edba253-e75f-4153-8eab-02fc9abe8980 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:13.429262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3edba253-e75f-4153-8eab-02fc9abe8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:13.490500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.515215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b7609-7676-4854-8812-169637c76269 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.516170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 123/254] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:13.517455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba253-e75f-4153-8eab-02fc9abe8980 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.575518 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30c407-5e1f-4ce7-baa9-0227f645086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.576843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30c407-5e1f-4ce7-baa9-0227f645086b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.577363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30c407-5e1f-4ce7-baa9-0227f645086b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.577834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30c407-5e1f-4ce7-baa9-0227f645086b None admin] PATH_INFO: `/v3/users/1cb1d92bccdd4296ba8cb141856bc29a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.579306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30c407-5e1f-4ce7-baa9-0227f645086b None admin] RBAC: Authorizing `identity:get_user(user_id=1cb1d92bccdd4296ba8cb141856bc29a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.581712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30c407-5e1f-4ce7-baa9-0227f645086b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.588016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 132/255] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/users/1cb1d92bccdd4296ba8cb141856bc29a => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:13.589054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30c407-5e1f-4ce7-baa9-0227f645086b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.645033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba253-e75f-4153-8eab-02fc9abe8980 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.688737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4657d1-bca3-4cf1-a51d-8c7acb44e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.689537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4657d1-bca3-4cf1-a51d-8c7acb44e577 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.690444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4657d1-bca3-4cf1-a51d-8c7acb44e577 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.690717 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4657d1-bca3-4cf1-a51d-8c7acb44e577 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.692846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.696115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30c407-5e1f-4ce7-baa9-0227f645086b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.702600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4657d1-bca3-4cf1-a51d-8c7acb44e577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8a4657d1-bca3-4cf1-a51d-8c7acb44e577 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:13.711472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:13.712376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:13.713150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 124/256] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:13.713784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4657d1-bca3-4cf1-a51d-8c7acb44e577 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.751805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9caa0-093e-4768-a2e2-268ef4796c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.753540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9caa0-093e-4768-a2e2-268ef4796c78 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.753819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9caa0-093e-4768-a2e2-268ef4796c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.754091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9caa0-093e-4768-a2e2-268ef4796c78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.765257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9caa0-093e-4768-a2e2-268ef4796c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-52b9caa0-093e-4768-a2e2-268ef4796c78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:13.776957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:13.777804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:13.778575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 133/257] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:13.779196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9caa0-093e-4768-a2e2-268ef4796c78 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.796278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.882442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9caa0-093e-4768-a2e2-268ef4796c78 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.917708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.918292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.918578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.918853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.919614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:13.919952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.923928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.930176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 134/258] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:13.935396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.960938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4657d1-bca3-4cf1-a51d-8c7acb44e577 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.008363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.039618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07225-7e5c-4e40-a8d9-6532db3f86aa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.048576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354127a-5e33-496a-ac8b-296cada7aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.050242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354127a-5e33-496a-ac8b-296cada7aa8b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.050721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354127a-5e33-496a-ac8b-296cada7aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.051211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354127a-5e33-496a-ac8b-296cada7aa8b None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.052645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354127a-5e33-496a-ac8b-296cada7aa8b None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.054316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354127a-5e33-496a-ac8b-296cada7aa8b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.056248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 125/259] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:14.057191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354127a-5e33-496a-ac8b-296cada7aa8b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.085514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.086231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.086515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.086791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.087550 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:14.087858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.089396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.098840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 135/260] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:14.099725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.188597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.202809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60e8bc-7370-45e0-9a22-73e72122620e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.233679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.238478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de9d89-0e1a-4063-8b2c-dad857d3cc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.239362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de9d89-0e1a-4063-8b2c-dad857d3cc1d None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.239650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de9d89-0e1a-4063-8b2c-dad857d3cc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.239946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de9d89-0e1a-4063-8b2c-dad857d3cc1d None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4/users/1cb1d92bccdd4296ba8cb141856bc29a/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.242402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de9d89-0e1a-4063-8b2c-dad857d3cc1d None admin] RBAC: Authorizing `identity:create_grant(project_id=d21689e5ee72418fa4d0466bd95317f4, user_id=1cb1d92bccdd4296ba8cb141856bc29a, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.243931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de9d89-0e1a-4063-8b2c-dad857d3cc1d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.262859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354127a-5e33-496a-ac8b-296cada7aa8b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.299261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa567ab-3517-4951-acc6-3475d0432ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.300302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa567ab-3517-4951-acc6-3475d0432ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.300589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa567ab-3517-4951-acc6-3475d0432ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.300911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa567ab-3517-4951-acc6-3475d0432ab8 None admin] PATH_INFO: `/v3/users/e580a1e7afb547d79ad679db265e73f0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.302255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa567ab-3517-4951-acc6-3475d0432ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=e580a1e7afb547d79ad679db265e73f0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.303764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa567ab-3517-4951-acc6-3475d0432ab8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.310155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 126/261] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/users/e580a1e7afb547d79ad679db265e73f0 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:14.310981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa567ab-3517-4951-acc6-3475d0432ab8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.325473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 136/262] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:14 2022] PUT /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4/users/1cb1d92bccdd4296ba8cb141856bc29a/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:14.329479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de9d89-0e1a-4063-8b2c-dad857d3cc1d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.552563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa567ab-3517-4951-acc6-3475d0432ab8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.557185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de9d89-0e1a-4063-8b2c-dad857d3cc1d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.588570 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.602496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91322-c635-41a4-a854-0c0dfd34777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.603400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91322-c635-41a4-a854-0c0dfd34777f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.603781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91322-c635-41a4-a854-0c0dfd34777f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.604093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91322-c635-41a4-a854-0c0dfd34777f None admin] PATH_INFO: `/v3/users/e580a1e7afb547d79ad679db265e73f0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.613376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91322-c635-41a4-a854-0c0dfd34777f None admin] RBAC: Authorizing `identity:get_user(user_id=e580a1e7afb547d79ad679db265e73f0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.614952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91322-c635-41a4-a854-0c0dfd34777f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.616758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 127/263] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/users/e580a1e7afb547d79ad679db265e73f0 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:14.618853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c380d0a-ef1b-4225-8856-1d46cb0233be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.619514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380d0a-ef1b-4225-8856-1d46cb0233be None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.619795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380d0a-ef1b-4225-8856-1d46cb0233be None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.620093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380d0a-ef1b-4225-8856-1d46cb0233be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.622368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91322-c635-41a4-a854-0c0dfd34777f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.707412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.718704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380d0a-ef1b-4225-8856-1d46cb0233be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.720652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380d0a-ef1b-4225-8856-1d46cb0233be None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.833683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 137/264] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:14.841526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c380d0a-ef1b-4225-8856-1d46cb0233be None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.885869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91322-c635-41a4-a854-0c0dfd34777f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.984615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab074b6-cb73-4a26-8341-29d881a25b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.985280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab074b6-cb73-4a26-8341-29d881a25b63 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.985551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab074b6-cb73-4a26-8341-29d881a25b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.985841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab074b6-cb73-4a26-8341-29d881a25b63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.087983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.113185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c380d0a-ef1b-4225-8856-1d46cb0233be None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.138465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.147938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab074b6-cb73-4a26-8341-29d881a25b63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.149429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab074b6-cb73-4a26-8341-29d881a25b63 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.199823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c4940-f1ab-40ca-9890-a6b18c312dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.204773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c4940-f1ab-40ca-9890-a6b18c312dea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.205066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c4940-f1ab-40ca-9890-a6b18c312dea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.205468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c4940-f1ab-40ca-9890-a6b18c312dea None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.207949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c4940-f1ab-40ca-9890-a6b18c312dea None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.209397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c4940-f1ab-40ca-9890-a6b18c312dea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.211275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 138/265] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:15.217445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c4940-f1ab-40ca-9890-a6b18c312dea None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.377485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 128/266] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:22:15.385064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab074b6-cb73-4a26-8341-29d881a25b63 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.474008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c4940-f1ab-40ca-9890-a6b18c312dea None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.561302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.561965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.562251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.562524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.563365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=d21689e5ee72418fa4d0466bd95317f4, user.id=e580a1e7afb547d79ad679db265e73f0) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:15.563672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.565199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.576508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.578435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 139/267] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/role_assignments?user.id=e580a1e7afb547d79ad679db265e73f0&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 608 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:15.582373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab074b6-cb73-4a26-8341-29d881a25b63 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.666402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b17d-c528-4f2c-987f-13e3a2a7d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.667183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b17d-c528-4f2c-987f-13e3a2a7d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.667466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b17d-c528-4f2c-987f-13e3a2a7d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.667743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b17d-c528-4f2c-987f-13e3a2a7d2b1 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.672827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b17d-c528-4f2c-987f-13e3a2a7d2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.674855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b17d-c528-4f2c-987f-13e3a2a7d2b1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.677083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 129/268] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:15.682791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.742203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.843983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13898195-0648-4951-a1fc-6c1b2e628837 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.886409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333335-ba6e-4c01-829d-8416f7e1a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.887554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333335-ba6e-4c01-829d-8416f7e1a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.888084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333335-ba6e-4c01-829d-8416f7e1a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.888567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333335-ba6e-4c01-829d-8416f7e1a5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.889645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333335-ba6e-4c01-829d-8416f7e1a5a8 None admin] RBAC: Adding query filter params (role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=d21689e5ee72418fa4d0466bd95317f4, user.id=e580a1e7afb547d79ad679db265e73f0) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:15.890216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333335-ba6e-4c01-829d-8416f7e1a5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.892066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333335-ba6e-4c01-829d-8416f7e1a5a8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.905954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 140/269] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/role_assignments?user.id=e580a1e7afb547d79ad679db265e73f0&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:15.968707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0765a-172d-489a-bb10-f9774309db80 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.969355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0765a-172d-489a-bb10-f9774309db80 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.969640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0765a-172d-489a-bb10-f9774309db80 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.971967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 130/270] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:15.978847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916282-114a-43b1-8818-e87f59a929f6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.978847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916282-114a-43b1-8818-e87f59a929f6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.978847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916282-114a-43b1-8818-e87f59a929f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.997429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2f916282-114a-43b1-8818-e87f59a929f6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:15.998982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2f916282-114a-43b1-8818-e87f59a929f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:16.063015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b34cc-45f3-4db4-83af-7ae8bfdcff37 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.063521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b34cc-45f3-4db4-83af-7ae8bfdcff37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.063592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b34cc-45f3-4db4-83af-7ae8bfdcff37 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.072055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 131/271] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:16.079536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 141/272] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:16.082402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad092d36-affa-491a-aa76-433fe0dac4a5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.082686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad092d36-affa-491a-aa76-433fe0dac4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.082958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad092d36-affa-491a-aa76-433fe0dac4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.105969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916282-114a-43b1-8818-e87f59a929f6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.106958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ad092d36-affa-491a-aa76-433fe0dac4a5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:16.112434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ad092d36-affa-491a-aa76-433fe0dac4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:16.132297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.212715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 132/273] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:16.214495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc05d4-8c72-440d-924a-73a194d193de None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.214783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc05d4-8c72-440d-924a-73a194d193de None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.215062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc05d4-8c72-440d-924a-73a194d193de None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.216839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 133/274] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:16.222170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1d632-9a5d-4030-be46-308aa284102a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.222366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1d632-9a5d-4030-be46-308aa284102a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.222640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1d632-9a5d-4030-be46-308aa284102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.230787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916282-114a-43b1-8818-e87f59a929f6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.240843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cfc1d632-9a5d-4030-be46-308aa284102a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:16.242382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cfc1d632-9a5d-4030-be46-308aa284102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:16.279442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472b1b-c4b3-480d-a2d3-1f98ddd42eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.280265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472b1b-c4b3-480d-a2d3-1f98ddd42eec None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.280542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472b1b-c4b3-480d-a2d3-1f98ddd42eec None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.280855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472b1b-c4b3-480d-a2d3-1f98ddd42eec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.295453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18472b1b-c4b3-480d-a2d3-1f98ddd42eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-18472b1b-c4b3-480d-a2d3-1f98ddd42eec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:16.303678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:16.304627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:16.305432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:16.306043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 142/275] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:16.306912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472b1b-c4b3-480d-a2d3-1f98ddd42eec None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.330128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 134/276] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:16.331443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1d632-9a5d-4030-be46-308aa284102a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.365443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.398800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.419409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472b1b-c4b3-480d-a2d3-1f98ddd42eec None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.442109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1d632-9a5d-4030-be46-308aa284102a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.452873 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848b0bf-96d8-4b84-bff2-c3e5d778f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.453649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848b0bf-96d8-4b84-bff2-c3e5d778f432 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.453924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848b0bf-96d8-4b84-bff2-c3e5d778f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.454198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848b0bf-96d8-4b84-bff2-c3e5d778f432 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.455874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848b0bf-96d8-4b84-bff2-c3e5d778f432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.457330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848b0bf-96d8-4b84-bff2-c3e5d778f432 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.458916 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 143/277] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:16.459662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848b0bf-96d8-4b84-bff2-c3e5d778f432 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.482353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.482942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.483222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.483491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.484257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:16.484561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.485928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.498486 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 135/278] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:16.498486 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.566166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848b0bf-96d8-4b84-bff2-c3e5d778f432 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.598453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.601586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5216de5-9f0b-4b21-81a3-4cf342715850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.602572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216de5-9f0b-4b21-81a3-4cf342715850 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.603022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216de5-9f0b-4b21-81a3-4cf342715850 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.603462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216de5-9f0b-4b21-81a3-4cf342715850 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.610035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0342ca3-8dfa-443f-ac70-2dc7eecf4ad0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.614180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5216de5-9f0b-4b21-81a3-4cf342715850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e5216de5-9f0b-4b21-81a3-4cf342715850 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:16.621936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:16.622785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:16.623534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:16.625022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 144/279] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:16.625990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5216de5-9f0b-4b21-81a3-4cf342715850 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.637398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.650476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07ab7b-6970-4df7-a229-2f7c183d259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.651217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07ab7b-6970-4df7-a229-2f7c183d259c None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.651498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07ab7b-6970-4df7-a229-2f7c183d259c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.651773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07ab7b-6970-4df7-a229-2f7c183d259c None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.652593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07ab7b-6970-4df7-a229-2f7c183d259c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.654109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07ab7b-6970-4df7-a229-2f7c183d259c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.726284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5216de5-9f0b-4b21-81a3-4cf342715850 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.762219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de6845-9c15-4589-ac5d-5ced5f2e39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.763091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de6845-9c15-4589-ac5d-5ced5f2e39b3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.763373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de6845-9c15-4589-ac5d-5ced5f2e39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.763648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de6845-9c15-4589-ac5d-5ced5f2e39b3 None admin] PATH_INFO: `/v3/users/c941248ae4234672ae8704cb26a8d340` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.764417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 136/280] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:16 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:16.775893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07ab7b-6970-4df7-a229-2f7c183d259c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.779851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de6845-9c15-4589-ac5d-5ced5f2e39b3 None admin] RBAC: Authorizing `identity:get_user(user_id=c941248ae4234672ae8704cb26a8d340)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.781395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de6845-9c15-4589-ac5d-5ced5f2e39b3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.783524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 145/281] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/users/c941248ae4234672ae8704cb26a8d340 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:16.789088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de6845-9c15-4589-ac5d-5ced5f2e39b3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.889073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.905869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07ab7b-6970-4df7-a229-2f7c183d259c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.946035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de6845-9c15-4589-ac5d-5ced5f2e39b3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.948024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.949898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.950276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.950637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.951466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:16.951848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.953578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.965436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 137/282] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:16.972042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.983311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.998426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717281e0-def4-4231-a253-bcef19b2f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.998426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717281e0-def4-4231-a253-bcef19b2f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.998426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717281e0-def4-4231-a253-bcef19b2f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.998723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717281e0-def4-4231-a253-bcef19b2f0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.999497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717281e0-def4-4231-a253-bcef19b2f0e9 None admin] RBAC: Adding query filter params (role.id=a7a423c4a93a47adb277eb4b35903b4c, user.id=c941248ae4234672ae8704cb26a8d340, scope.system=all) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:16.999816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717281e0-def4-4231-a253-bcef19b2f0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.003395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717281e0-def4-4231-a253-bcef19b2f0e9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.009275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 146/283] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/role_assignments?user.id=c941248ae4234672ae8704cb26a8d340&scope.system=all&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:17.108707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426fba-7964-46fe-941b-f88ac77ea98a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.149798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5513a-cb27-4225-91f8-44f5f8e1a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.151113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5513a-cb27-4225-91f8-44f5f8e1a36e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.151600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5513a-cb27-4225-91f8-44f5f8e1a36e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.152101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5513a-cb27-4225-91f8-44f5f8e1a36e None admin] PATH_INFO: `/v3/users/bffeadac0c9246d1b376eb97cbea0198` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.153621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5513a-cb27-4225-91f8-44f5f8e1a36e None admin] RBAC: Authorizing `identity:get_user(user_id=bffeadac0c9246d1b376eb97cbea0198)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.154647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b9311-8327-43c1-90ed-e583632f78e4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.154941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b9311-8327-43c1-90ed-e583632f78e4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.155224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b9311-8327-43c1-90ed-e583632f78e4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.155939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5513a-cb27-4225-91f8-44f5f8e1a36e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.156640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 147/284] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:17.158200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 138/285] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/users/bffeadac0c9246d1b376eb97cbea0198 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:17.163775 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100d34e-18f1-4baa-80e2-462ff733b09d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.164097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100d34e-18f1-4baa-80e2-462ff733b09d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.164307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5513a-cb27-4225-91f8-44f5f8e1a36e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.164442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100d34e-18f1-4baa-80e2-462ff733b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.184729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8100d34e-18f1-4baa-80e2-462ff733b09d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:17.186088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8100d34e-18f1-4baa-80e2-462ff733b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:17.267360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.292979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 148/286] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:17.314120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5513a-cb27-4225-91f8-44f5f8e1a36e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.350504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100d34e-18f1-4baa-80e2-462ff733b09d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.373785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37696c-368c-42b5-aa25-db75e26d3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.374646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37696c-368c-42b5-aa25-db75e26d3f4b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.374931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37696c-368c-42b5-aa25-db75e26d3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.375206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37696c-368c-42b5-aa25-db75e26d3f4b None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.377770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37696c-368c-42b5-aa25-db75e26d3f4b None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.379235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37696c-368c-42b5-aa25-db75e26d3f4b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.380977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 139/287] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:17.387926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37696c-368c-42b5-aa25-db75e26d3f4b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.462571 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.545190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100d34e-18f1-4baa-80e2-462ff733b09d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.549100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37696c-368c-42b5-aa25-db75e26d3f4b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.587703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a05d91-3167-41dc-ba0d-ded538e125f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.588937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a05d91-3167-41dc-ba0d-ded538e125f5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.589416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a05d91-3167-41dc-ba0d-ded538e125f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.589910 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a05d91-3167-41dc-ba0d-ded538e125f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.603887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a05d91-3167-41dc-ba0d-ded538e125f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:17.617930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64995-77ef-4c04-9751-a2ee1db300df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.618866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64995-77ef-4c04-9751-a2ee1db300df None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.619152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64995-77ef-4c04-9751-a2ee1db300df None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f4a05d91-3167-41dc-ba0d-ded538e125f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:17.619383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:17.620284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:17.621086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:17.621694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd64995-77ef-4c04-9751-a2ee1db300df None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4/users/bffeadac0c9246d1b376eb97cbea0198/roles/e9ba98fdb77f4aadae316c27d3e158ae` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.621761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 149/288] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:17.625950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd64995-77ef-4c04-9751-a2ee1db300df None admin] RBAC: Authorizing `identity:create_grant(project_id=d21689e5ee72418fa4d0466bd95317f4, user_id=bffeadac0c9246d1b376eb97cbea0198, role_id=e9ba98fdb77f4aadae316c27d3e158ae)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.626167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a05d91-3167-41dc-ba0d-ded538e125f5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.627955 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd64995-77ef-4c04-9751-a2ee1db300df None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.691975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 140/289] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:17 2022] PUT /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4/users/bffeadac0c9246d1b376eb97cbea0198/roles/e9ba98fdb77f4aadae316c27d3e158ae => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:17.769025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a05d91-3167-41dc-ba0d-ded538e125f5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.801472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.828789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.829486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.829767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.830040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.830874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:17.831176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.832602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.843435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 150/290] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:17.849028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64995-77ef-4c04-9751-a2ee1db300df None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.858276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.981410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd64995-77ef-4c04-9751-a2ee1db300df None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.018018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db5b3-5663-42de-a755-8bd75a977664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.019233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db5b3-5663-42de-a755-8bd75a977664 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.019732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db5b3-5663-42de-a755-8bd75a977664 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.020359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1db5b3-5663-42de-a755-8bd75a977664 None admin] PATH_INFO: `/v3/users/1cb1d92bccdd4296ba8cb141856bc29a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.023103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1db5b3-5663-42de-a755-8bd75a977664 None admin] RBAC: Authorizing `identity:get_user(user_id=1cb1d92bccdd4296ba8cb141856bc29a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.024768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1db5b3-5663-42de-a755-8bd75a977664 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.026917 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 141/291] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/users/1cb1d92bccdd4296ba8cb141856bc29a => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:18.032031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.162047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993334bf-55e8-4b96-a04b-cb326c8d8cca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.204788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1e74-e27f-4dcc-a20e-07161bbae6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.205523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1e74-e27f-4dcc-a20e-07161bbae6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.205805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1e74-e27f-4dcc-a20e-07161bbae6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.206076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1e74-e27f-4dcc-a20e-07161bbae6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.271255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:18.295260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1e74-e27f-4dcc-a20e-07161bbae6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.296868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1e74-e27f-4dcc-a20e-07161bbae6f3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.419984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 151/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:18.425555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db5b3-5663-42de-a755-8bd75a977664 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.547110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:18.587581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1db5b3-5663-42de-a755-8bd75a977664 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.633438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086bf56-768f-495c-b946-7168cb38979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.634556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086bf56-768f-495c-b946-7168cb38979e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.634833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086bf56-768f-495c-b946-7168cb38979e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.635104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086bf56-768f-495c-b946-7168cb38979e None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.636290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086bf56-768f-495c-b946-7168cb38979e None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.637713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086bf56-768f-495c-b946-7168cb38979e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.639681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 142/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:18.645203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1e74-e27f-4dcc-a20e-07161bbae6f3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.766470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:18.791042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1e74-e27f-4dcc-a20e-07161bbae6f3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.840587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56918eb-2c2f-4656-918a-0ea7b52e1895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.841328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56918eb-2c2f-4656-918a-0ea7b52e1895 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.841526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56918eb-2c2f-4656-918a-0ea7b52e1895 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.841784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56918eb-2c2f-4656-918a-0ea7b52e1895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.842607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56918eb-2c2f-4656-918a-0ea7b52e1895 None admin] RBAC: Adding query filter params (role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=d21689e5ee72418fa4d0466bd95317f4, user.id=1cb1d92bccdd4296ba8cb141856bc29a) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:18.842915 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56918eb-2c2f-4656-918a-0ea7b52e1895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.844371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56918eb-2c2f-4656-918a-0ea7b52e1895 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.851419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 152/294] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/role_assignments?user.id=1cb1d92bccdd4296ba8cb141856bc29a&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:19.443666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f153-28c7-4770-8a1b-14ee5650284b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.444267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f153-28c7-4770-8a1b-14ee5650284b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.444267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f153-28c7-4770-8a1b-14ee5650284b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.445867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 143/295] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:19.452852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22b0e-24b7-4fda-9502-db57e5adbcb3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.452852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22b0e-24b7-4fda-9502-db57e5adbcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.452852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22b0e-24b7-4fda-9502-db57e5adbcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.469341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-61d22b0e-24b7-4fda-9502-db57e5adbcb3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:19.470900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-61d22b0e-24b7-4fda-9502-db57e5adbcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:19.478997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f585c8-38ae-46d4-b5e0-77bbe3440acc None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.479284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f585c8-38ae-46d4-b5e0-77bbe3440acc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.479564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f585c8-38ae-46d4-b5e0-77bbe3440acc None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.481231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 144/296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:19.485875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d9eab-3423-40ca-b7f4-0b9e349a9829 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.486161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d9eab-3423-40ca-b7f4-0b9e349a9829 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.486525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d9eab-3423-40ca-b7f4-0b9e349a9829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.507322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-449d9eab-3423-40ca-b7f4-0b9e349a9829 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:19.508991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-449d9eab-3423-40ca-b7f4-0b9e349a9829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:19.545313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 153/297] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:19.568015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d22b0e-24b7-4fda-9502-db57e5adbcb3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.585050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 145/298] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:19.607860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d9eab-3423-40ca-b7f4-0b9e349a9829 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.655358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.679873 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d22b0e-24b7-4fda-9502-db57e5adbcb3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.691964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.717392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414191ec-0ff5-4267-917a-7c8a9844c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.718080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414191ec-0ff5-4267-917a-7c8a9844c94b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.718369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414191ec-0ff5-4267-917a-7c8a9844c94b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.718644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414191ec-0ff5-4267-917a-7c8a9844c94b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.719767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414191ec-0ff5-4267-917a-7c8a9844c94b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.721283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414191ec-0ff5-4267-917a-7c8a9844c94b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.723951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 154/299] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:19.724423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bdca-7524-4748-8996-f1e7b61e1976 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.724701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bdca-7524-4748-8996-f1e7b61e1976 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.724974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195bdca-7524-4748-8996-f1e7b61e1976 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.726342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 155/300] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:19.729329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195bdca-7524-4748-8996-f1e7b61e1976 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.731263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d9eab-3423-40ca-b7f4-0b9e349a9829 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.769658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed1290-9fab-44ee-8396-fcb29d409f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.770446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed1290-9fab-44ee-8396-fcb29d409f93 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.770725 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed1290-9fab-44ee-8396-fcb29d409f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.770998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed1290-9fab-44ee-8396-fcb29d409f93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.781357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed1290-9fab-44ee-8396-fcb29d409f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e1ed1290-9fab-44ee-8396-fcb29d409f93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:19.789285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:19.790156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:19.790925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 146/301] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:19.791982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484884ed-dc59-4074-99b7-75ce3e5b2447 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.792409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484884ed-dc59-4074-99b7-75ce3e5b2447 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.792845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484884ed-dc59-4074-99b7-75ce3e5b2447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.810477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-484884ed-dc59-4074-99b7-75ce3e5b2447 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:19.812786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-484884ed-dc59-4074-99b7-75ce3e5b2447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:19.843286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195bdca-7524-4748-8996-f1e7b61e1976 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.878723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa338c4-f345-4c6c-8dcd-c81e3b1d5ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.879380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa338c4-f345-4c6c-8dcd-c81e3b1d5ac7 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.879656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa338c4-f345-4c6c-8dcd-c81e3b1d5ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.879943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa338c4-f345-4c6c-8dcd-c81e3b1d5ac7 None admin] PATH_INFO: `/v3/groups` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.880622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa338c4-f345-4c6c-8dcd-c81e3b1d5ac7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.882058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa338c4-f345-4c6c-8dcd-c81e3b1d5ac7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.887683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 147/302] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:19.888464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484884ed-dc59-4074-99b7-75ce3e5b2447 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.946835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.948919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 156/303] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Jun 15 00:22:19 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:19.949972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa338c4-f345-4c6c-8dcd-c81e3b1d5ac7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.952796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.021179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484884ed-dc59-4074-99b7-75ce3e5b2447 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.073709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa338c4-f345-4c6c-8dcd-c81e3b1d5ac7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.074616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.075304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.075592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.075862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.076958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.077266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.079719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.091118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 148/304] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:20.098284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.123642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d25e-fbda-4969-86af-dea39fa88ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.124938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d25e-fbda-4969-86af-dea39fa88ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.125439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d25e-fbda-4969-86af-dea39fa88ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.125917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264d25e-fbda-4969-86af-dea39fa88ac5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.138531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264d25e-fbda-4969-86af-dea39fa88ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1264d25e-fbda-4969-86af-dea39fa88ac5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:20.147537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.148671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:20.149631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:20.151867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 157/305] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.158240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d25e-fbda-4969-86af-dea39fa88ac5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.221333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796553c-3c58-4837-9867-4fa45aa9ba23 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.242138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.242859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.256497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497ded-ae0a-480e-95e7-34603e18fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.257707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497ded-ae0a-480e-95e7-34603e18fc73 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.258201 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497ded-ae0a-480e-95e7-34603e18fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.258935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497ded-ae0a-480e-95e7-34603e18fc73 None admin] PATH_INFO: `/v3/users/9f8978b221944c0aa5044578ec0dcc68` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.272582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8497ded-ae0a-480e-95e7-34603e18fc73 None admin] RBAC: Authorizing `identity:get_user(user_id=9f8978b221944c0aa5044578ec0dcc68)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.274345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8497ded-ae0a-480e-95e7-34603e18fc73 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.276463 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 149/306] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/users/9f8978b221944c0aa5044578ec0dcc68 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:20.282367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497ded-ae0a-480e-95e7-34603e18fc73 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.291068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264d25e-fbda-4969-86af-dea39fa88ac5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.336270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.337922 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.338399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.338845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.339802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.340320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.342961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.357072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 158/307] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:20.363441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.400906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497ded-ae0a-480e-95e7-34603e18fc73 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.440853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d25c0-bc12-44d4-b8d2-a2225dca550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.441510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d25c0-bc12-44d4-b8d2-a2225dca550b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.441860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d25c0-bc12-44d4-b8d2-a2225dca550b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.442060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d25c0-bc12-44d4-b8d2-a2225dca550b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.442878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d25c0-bc12-44d4-b8d2-a2225dca550b None admin] RBAC: Adding query filter params (role.id=e9ba98fdb77f4aadae316c27d3e158ae, user.id=9f8978b221944c0aa5044578ec0dcc68, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.443323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d25c0-bc12-44d4-b8d2-a2225dca550b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.444624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d25c0-bc12-44d4-b8d2-a2225dca550b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.454119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 150/308] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/role_assignments?user.id=9f8978b221944c0aa5044578ec0dcc68&scope.system=all&role.id=e9ba98fdb77f4aadae316c27d3e158ae => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:20.458388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e41-c6d1-4599-a5b5-ec3d908b26fb None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.458388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e41-c6d1-4599-a5b5-ec3d908b26fb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.458388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e41-c6d1-4599-a5b5-ec3d908b26fb None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.458388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 151/309] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:20.462529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8059e-03b5-4261-83d9-3e7ab0def094 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.463949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8059e-03b5-4261-83d9-3e7ab0def094 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.463949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8059e-03b5-4261-83d9-3e7ab0def094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.480756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d8c8059e-03b5-4261-83d9-3e7ab0def094 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:20.481945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d8c8059e-03b5-4261-83d9-3e7ab0def094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:20.495082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de01e7-6324-4886-90df-b3fe72dde19b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.523486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.536218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33139965-dcb8-410e-8c30-84d01eb54495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.537512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33139965-dcb8-410e-8c30-84d01eb54495 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.538021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33139965-dcb8-410e-8c30-84d01eb54495 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.538494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33139965-dcb8-410e-8c30-84d01eb54495 None admin] PATH_INFO: `/v3/users/c941248ae4234672ae8704cb26a8d340` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.539479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.540224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33139965-dcb8-410e-8c30-84d01eb54495 None admin] RBAC: Authorizing `identity:get_user(user_id=c941248ae4234672ae8704cb26a8d340)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.541858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33139965-dcb8-410e-8c30-84d01eb54495 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.543732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 159/310] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/users/c941248ae4234672ae8704cb26a8d340 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:20.550193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33139965-dcb8-410e-8c30-84d01eb54495 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.584070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 152/311] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:20.612128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8059e-03b5-4261-83d9-3e7ab0def094 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.698531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33139965-dcb8-410e-8c30-84d01eb54495 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.725234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8059e-03b5-4261-83d9-3e7ab0def094 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.751571 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108159e3-55ef-4f5f-9ba9-0512959feaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.753022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108159e3-55ef-4f5f-9ba9-0512959feaa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.753301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108159e3-55ef-4f5f-9ba9-0512959feaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.753575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108159e3-55ef-4f5f-9ba9-0512959feaa4 None admin] PATH_INFO: `/v3/system/users/c941248ae4234672ae8704cb26a8d340/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.755858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108159e3-55ef-4f5f-9ba9-0512959feaa4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c941248ae4234672ae8704cb26a8d340, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.757524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108159e3-55ef-4f5f-9ba9-0512959feaa4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.770112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2971db-0ae5-4a53-91e6-78ae0a21c7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.771247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2971db-0ae5-4a53-91e6-78ae0a21c7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.773469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2971db-0ae5-4a53-91e6-78ae0a21c7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.773469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2971db-0ae5-4a53-91e6-78ae0a21c7c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.783612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2971db-0ae5-4a53-91e6-78ae0a21c7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ef2971db-0ae5-4a53-91e6-78ae0a21c7c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:20.791940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.792864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:20.793830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:20.795852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 153/312] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.802371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2971db-0ae5-4a53-91e6-78ae0a21c7c0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.836691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.844120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 160/313] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jun 15 00:22:20 2022] PUT /identity/v3/system/users/c941248ae4234672ae8704cb26a8d340/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:22:20.922928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2971db-0ae5-4a53-91e6-78ae0a21c7c0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.960435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.961111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.961390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.961666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.962426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.962734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.964146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.973559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 154/314] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:20.978711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108159e3-55ef-4f5f-9ba9-0512959feaa4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.043347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.103208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108159e3-55ef-4f5f-9ba9-0512959feaa4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.138078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b04b1-9501-416d-9167-9f9ff44c07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.138939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b04b1-9501-416d-9167-9f9ff44c07cb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.139217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b04b1-9501-416d-9167-9f9ff44c07cb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.139487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b04b1-9501-416d-9167-9f9ff44c07cb None admin] PATH_INFO: `/v3/users/bffeadac0c9246d1b376eb97cbea0198` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.140688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b04b1-9501-416d-9167-9f9ff44c07cb None admin] RBAC: Authorizing `identity:get_user(user_id=bffeadac0c9246d1b376eb97cbea0198)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.142126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b04b1-9501-416d-9167-9f9ff44c07cb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.144610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 161/315] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/users/bffeadac0c9246d1b376eb97cbea0198 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:21.150114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.251534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.258841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4df596-ee81-483e-b36e-dff54aae6e90 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.293035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5e3d6-dc41-4a98-ad2c-8d4ec4aa2c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.293744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e3d6-dc41-4a98-ad2c-8d4ec4aa2c5d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.293966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e3d6-dc41-4a98-ad2c-8d4ec4aa2c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.294244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5e3d6-dc41-4a98-ad2c-8d4ec4aa2c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.364598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5e3d6-dc41-4a98-ad2c-8d4ec4aa2c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.366062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5e3d6-dc41-4a98-ad2c-8d4ec4aa2c5d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.460256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.465048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 155/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:21.471294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b04b1-9501-416d-9167-9f9ff44c07cb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.577982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b04b1-9501-416d-9167-9f9ff44c07cb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.603415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.614034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0cb0f-061e-47af-8790-0de8b6d73b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.614899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0cb0f-061e-47af-8790-0de8b6d73b27 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.615189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0cb0f-061e-47af-8790-0de8b6d73b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.615467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0cb0f-061e-47af-8790-0de8b6d73b27 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.616692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0cb0f-061e-47af-8790-0de8b6d73b27 None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.618177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0cb0f-061e-47af-8790-0de8b6d73b27 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.619882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 162/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:21.626203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5e3d6-dc41-4a98-ad2c-8d4ec4aa2c5d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.746093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5e3d6-dc41-4a98-ad2c-8d4ec4aa2c5d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.780339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b80b33-2981-458f-858b-2c9bea8528ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.780993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80b33-2981-458f-858b-2c9bea8528ab None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.781274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80b33-2981-458f-858b-2c9bea8528ab None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.781545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80b33-2981-458f-858b-2c9bea8528ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.782372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b80b33-2981-458f-858b-2c9bea8528ab None admin] RBAC: Adding query filter params (role.id=e9ba98fdb77f4aadae316c27d3e158ae, scope.project.id=d21689e5ee72418fa4d0466bd95317f4, user.id=bffeadac0c9246d1b376eb97cbea0198) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:21.782680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b80b33-2981-458f-858b-2c9bea8528ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.784192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b80b33-2981-458f-858b-2c9bea8528ab None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.790383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 156/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/role_assignments?user.id=bffeadac0c9246d1b376eb97cbea0198&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=e9ba98fdb77f4aadae316c27d3e158ae => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:22.292463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa45e84-3a8e-4205-bdb2-21ee191322db None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.292977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa45e84-3a8e-4205-bdb2-21ee191322db None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.293095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa45e84-3a8e-4205-bdb2-21ee191322db None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.294366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 163/319] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:22.299534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18a93-db43-410e-b20e-3c9ec2567484 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.299819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18a93-db43-410e-b20e-3c9ec2567484 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.300118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18a93-db43-410e-b20e-3c9ec2567484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.316454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fae18a93-db43-410e-b20e-3c9ec2567484 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:22.317646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fae18a93-db43-410e-b20e-3c9ec2567484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:22.371460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.385360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 157/320] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:22.407650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa45e84-3a8e-4205-bdb2-21ee191322db None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.508156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa45e84-3a8e-4205-bdb2-21ee191322db None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.545466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c6d8d-5197-4280-ada1-d1e7c6df4d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.546183 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c6d8d-5197-4280-ada1-d1e7c6df4d46 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.546465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c6d8d-5197-4280-ada1-d1e7c6df4d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.546733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c6d8d-5197-4280-ada1-d1e7c6df4d46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.548049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c6d8d-5197-4280-ada1-d1e7c6df4d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.550053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c6d8d-5197-4280-ada1-d1e7c6df4d46 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.551996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 164/321] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:22.557608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18a93-db43-410e-b20e-3c9ec2567484 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.621921 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f946-c9f8-4def-8475-878f7874457a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.622214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f946-c9f8-4def-8475-878f7874457a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.622534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24f946-c9f8-4def-8475-878f7874457a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.624080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 165/322] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:22.628896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd888-7cc7-4b38-a8c3-5f133ea23fc2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.629182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd888-7cc7-4b38-a8c3-5f133ea23fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.629456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd888-7cc7-4b38-a8c3-5f133ea23fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.646020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5bffd888-7cc7-4b38-a8c3-5f133ea23fc2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:22.647193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5bffd888-7cc7-4b38-a8c3-5f133ea23fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:22.670255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18a93-db43-410e-b20e-3c9ec2567484 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.703844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.709295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38b71-ed75-4d93-89f2-79be93593218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.712762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38b71-ed75-4d93-89f2-79be93593218 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.712762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38b71-ed75-4d93-89f2-79be93593218 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.712762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38b71-ed75-4d93-89f2-79be93593218 None admin] PATH_INFO: `/v3/groups` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.712762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b38b71-ed75-4d93-89f2-79be93593218 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.712762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b38b71-ed75-4d93-89f2-79be93593218 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.715639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 166/323] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:22.738750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd888-7cc7-4b38-a8c3-5f133ea23fc2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.810761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 158/324] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Jun 15 00:22:22 2022] POST /identity/v3/groups => generated 226 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:22.855981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd888-7cc7-4b38-a8c3-5f133ea23fc2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.909746 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57597-1385-4d30-a453-4da141ad4a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.911008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57597-1385-4d30-a453-4da141ad4a05 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.911443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57597-1385-4d30-a453-4da141ad4a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.911861 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57597-1385-4d30-a453-4da141ad4a05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.929591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac57597-1385-4d30-a453-4da141ad4a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8ac57597-1385-4d30-a453-4da141ad4a05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:22.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:22.944645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:22.945440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:22.948225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 167/325] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:22.954426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38b71-ed75-4d93-89f2-79be93593218 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.040152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.054186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f492-e25c-4a0d-a6ad-94ff1de600c7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.054477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f492-e25c-4a0d-a6ad-94ff1de600c7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.054755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f492-e25c-4a0d-a6ad-94ff1de600c7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.056319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 168/326] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:23.061519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5a4b-610a-4bc2-a0f9-d03f055d97e2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.061745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5a4b-610a-4bc2-a0f9-d03f055d97e2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.062025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa5a4b-610a-4bc2-a0f9-d03f055d97e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.083043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-73fa5a4b-610a-4bc2-a0f9-d03f055d97e2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:23.084275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-73fa5a4b-610a-4bc2-a0f9-d03f055d97e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:23.107467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38b71-ed75-4d93-89f2-79be93593218 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.143757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.153901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.155121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.155121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.155278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.155951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:23.156262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.157647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.168556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 159/327] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.170520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 169/328] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:23.174365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.194907 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa5a4b-610a-4bc2-a0f9-d03f055d97e2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.306254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805348f3-f36e-487b-b513-8c0bf12baccd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.322516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.324502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa5a4b-610a-4bc2-a0f9-d03f055d97e2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.352190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090171-d698-48b6-b846-066a690ad0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.353376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090171-d698-48b6-b846-066a690ad0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.353673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090171-d698-48b6-b846-066a690ad0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.354573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090171-d698-48b6-b846-066a690ad0c3 None admin] PATH_INFO: `/v3/users/9f8978b221944c0aa5044578ec0dcc68` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.355524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da090171-d698-48b6-b846-066a690ad0c3 None admin] RBAC: Authorizing `identity:get_user(user_id=9f8978b221944c0aa5044578ec0dcc68)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.357898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da090171-d698-48b6-b846-066a690ad0c3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.359733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 160/329] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/users/9f8978b221944c0aa5044578ec0dcc68 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.366675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090171-d698-48b6-b846-066a690ad0c3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.371230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee53e3-857b-4a2b-b6df-dc01830d0caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.372387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee53e3-857b-4a2b-b6df-dc01830d0caa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.372925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee53e3-857b-4a2b-b6df-dc01830d0caa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.373394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee53e3-857b-4a2b-b6df-dc01830d0caa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.386992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee53e3-857b-4a2b-b6df-dc01830d0caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-14ee53e3-857b-4a2b-b6df-dc01830d0caa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:23.395682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:23.396562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:23.397333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:23.399862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 170/330] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:23.406134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee53e3-857b-4a2b-b6df-dc01830d0caa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.464337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.501262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090171-d698-48b6-b846-066a690ad0c3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.546077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee53e3-857b-4a2b-b6df-dc01830d0caa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.551826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8050d0-8e24-4c2a-a0e0-74447ba7bfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.552734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8050d0-8e24-4c2a-a0e0-74447ba7bfd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.553010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8050d0-8e24-4c2a-a0e0-74447ba7bfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.553285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8050d0-8e24-4c2a-a0e0-74447ba7bfd5 None admin] PATH_INFO: `/v3/system/users/9f8978b221944c0aa5044578ec0dcc68/roles/e9ba98fdb77f4aadae316c27d3e158ae` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.555266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8050d0-8e24-4c2a-a0e0-74447ba7bfd5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f8978b221944c0aa5044578ec0dcc68, role_id=e9ba98fdb77f4aadae316c27d3e158ae)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.556669 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8050d0-8e24-4c2a-a0e0-74447ba7bfd5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.590344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.591390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.591870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.592414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.593465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:23.593970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.603503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.605683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 171/331] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.611014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.623950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 161/332] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jun 15 00:22:23 2022] PUT /identity/v3/system/users/9f8978b221944c0aa5044578ec0dcc68/roles/e9ba98fdb77f4aadae316c27d3e158ae => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:22:23.726393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f59b48-23b5-4e62-9c6e-b6be22ff29a7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.728234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.770592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d03b6f-1d4f-4c12-ba42-994cb1c0ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.771484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03b6f-1d4f-4c12-ba42-994cb1c0ae01 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.771763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03b6f-1d4f-4c12-ba42-994cb1c0ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.772075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d03b6f-1d4f-4c12-ba42-994cb1c0ae01 None admin] PATH_INFO: `/v3/users/c941248ae4234672ae8704cb26a8d340` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.773940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d03b6f-1d4f-4c12-ba42-994cb1c0ae01 None admin] RBAC: Authorizing `identity:get_user(user_id=c941248ae4234672ae8704cb26a8d340)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.775399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d03b6f-1d4f-4c12-ba42-994cb1c0ae01 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.777322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 172/333] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/users/c941248ae4234672ae8704cb26a8d340 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.783266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8050d0-8e24-4c2a-a0e0-74447ba7bfd5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.839368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.899887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8050d0-8e24-4c2a-a0e0-74447ba7bfd5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.938238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c207d9-62dd-4876-b317-e123396641cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.938904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c207d9-62dd-4876-b317-e123396641cc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.939182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c207d9-62dd-4876-b317-e123396641cc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.940395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c207d9-62dd-4876-b317-e123396641cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.941228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c207d9-62dd-4876-b317-e123396641cc None admin] RBAC: Adding query filter params (role.id=a7a423c4a93a47adb277eb4b35903b4c, user.id=c941248ae4234672ae8704cb26a8d340, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:23.941563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c207d9-62dd-4876-b317-e123396641cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.942966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c207d9-62dd-4876-b317-e123396641cc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.955717 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 162/334] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/role_assignments?user.id=c941248ae4234672ae8704cb26a8d340&scope.system=all&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:25.426301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba05d7-ceee-4fe4-b022-8af1ca389975 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.426837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba05d7-ceee-4fe4-b022-8af1ca389975 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.426837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba05d7-ceee-4fe4-b022-8af1ca389975 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.428236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 173/335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:25.433510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31877fe-661e-48c8-909f-bfde19fd8972 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.433925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31877fe-661e-48c8-909f-bfde19fd8972 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.434141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31877fe-661e-48c8-909f-bfde19fd8972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.451179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d31877fe-661e-48c8-909f-bfde19fd8972 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:25.452388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d31877fe-661e-48c8-909f-bfde19fd8972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:25.531330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 163/336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:25.571278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba05d7-ceee-4fe4-b022-8af1ca389975 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:25.703699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba05d7-ceee-4fe4-b022-8af1ca389975 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:25.725253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f64d-06a6-42ab-bcb6-a0c93ca1b9bc None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.725542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f64d-06a6-42ab-bcb6-a0c93ca1b9bc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.725780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f64d-06a6-42ab-bcb6-a0c93ca1b9bc None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.727140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 164/337] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:25.740916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21701-5a32-4db8-a46b-f1b1328086f9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.741236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21701-5a32-4db8-a46b-f1b1328086f9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.741468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21701-5a32-4db8-a46b-f1b1328086f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.753947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6685f7-1a50-4e1e-b5ad-87bb6a7e3ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:25.754749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6685f7-1a50-4e1e-b5ad-87bb6a7e3ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.755035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6685f7-1a50-4e1e-b5ad-87bb6a7e3ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.755308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6685f7-1a50-4e1e-b5ad-87bb6a7e3ac8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.765310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d2d21701-5a32-4db8-a46b-f1b1328086f9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:25.766502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d2d21701-5a32-4db8-a46b-f1b1328086f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:25.777710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6685f7-1a50-4e1e-b5ad-87bb6a7e3ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6c6685f7-1a50-4e1e-b5ad-87bb6a7e3ac8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:25.786012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:25.786862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:25.787665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:25.792017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 174/338] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:25.804355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:25.812378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6685f7-1a50-4e1e-b5ad-87bb6a7e3ac8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:25.889835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:25.898233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 165/339] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:25.944553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d21701-5a32-4db8-a46b-f1b1328086f9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.011621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6685f7-1a50-4e1e-b5ad-87bb6a7e3ac8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.098566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.099241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.099521 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.099793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.100571 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:26.100873 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.102238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.119472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 175/340] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:26.124791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.211626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d21701-5a32-4db8-a46b-f1b1328086f9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.275257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49756ed8-4b18-4c27-a332-83fb74110150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.276454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756ed8-4b18-4c27-a332-83fb74110150 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.276941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756ed8-4b18-4c27-a332-83fb74110150 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.277414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756ed8-4b18-4c27-a332-83fb74110150 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.299869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49756ed8-4b18-4c27-a332-83fb74110150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-49756ed8-4b18-4c27-a332-83fb74110150 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:26.308690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:26.309577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:26.310361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:26.316073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 166/341] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:26.317806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.322878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49756ed8-4b18-4c27-a332-83fb74110150 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.329903 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2d58-7294-4459-98f6-f2eaf8fcefea None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.372757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.405617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bbdc1-e17d-4443-88d5-4c7c000b92ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.406271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbdc1-e17d-4443-88d5-4c7c000b92ad None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.406547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbdc1-e17d-4443-88d5-4c7c000b92ad None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.406815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbdc1-e17d-4443-88d5-4c7c000b92ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.518392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49756ed8-4b18-4c27-a332-83fb74110150 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.570384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.571078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.571361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.571636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.572433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:26.572740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.575061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.581152 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bbdc1-e17d-4443-88d5-4c7c000b92ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.582641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bbdc1-e17d-4443-88d5-4c7c000b92ad None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.591135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 167/342] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:26.597220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.730964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.749714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ee28-e213-4e49-a98e-74bf37ca41f9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.797856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698bf98-f3e4-496f-b402-11771e2f5f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.799026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bf98-f3e4-496f-b402-11771e2f5f00 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.799319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bf98-f3e4-496f-b402-11771e2f5f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.799594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bf98-f3e4-496f-b402-11771e2f5f00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.901221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698bf98-f3e4-496f-b402-11771e2f5f00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.902634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698bf98-f3e4-496f-b402-11771e2f5f00 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.908269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.931173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 176/343] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:26.932577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7187af-a1ee-41eb-ab2f-cd95a12e6499 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.932862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7187af-a1ee-41eb-ab2f-cd95a12e6499 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.933136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7187af-a1ee-41eb-ab2f-cd95a12e6499 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.939170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 177/344] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:26.940727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7187af-a1ee-41eb-ab2f-cd95a12e6499 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.998351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:27.022881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 168/345] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:22:27.024393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758677-175c-42fe-a181-478d9d9b3f0d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.024681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758677-175c-42fe-a181-478d9d9b3f0d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.025003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a758677-175c-42fe-a181-478d9d9b3f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.048179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0a758677-175c-42fe-a181-478d9d9b3f0d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:27.050332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0a758677-175c-42fe-a181-478d9d9b3f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:27.077649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7187af-a1ee-41eb-ab2f-cd95a12e6499 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.118581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fa31e-ad80-4366-a122-58180b37b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.119614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa31e-ad80-4366-a122-58180b37b75b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.120021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa31e-ad80-4366-a122-58180b37b75b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.120447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fa31e-ad80-4366-a122-58180b37b75b None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.121748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fa31e-ad80-4366-a122-58180b37b75b None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:27.123305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fa31e-ad80-4366-a122-58180b37b75b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:27.125409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 178/346] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:27.126588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10313-0c93-4a98-ab3b-a95875594313 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.127408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10313-0c93-4a98-ab3b-a95875594313 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.127678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10313-0c93-4a98-ab3b-a95875594313 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.134864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 179/347] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:27.135613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d10313-0c93-4a98-ab3b-a95875594313 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.136115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 169/348] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:27.137137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a758677-175c-42fe-a181-478d9d9b3f0d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.244495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:27.252159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d10313-0c93-4a98-ab3b-a95875594313 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.259462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a758677-175c-42fe-a181-478d9d9b3f0d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.275392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:27.295088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d1090-1c49-47d2-9307-c9716021b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.296015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1090-1c49-47d2-9307-c9716021b35c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.296295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1090-1c49-47d2-9307-c9716021b35c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.296567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1090-1c49-47d2-9307-c9716021b35c None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.297738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d1090-1c49-47d2-9307-c9716021b35c None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:27.300721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d1090-1c49-47d2-9307-c9716021b35c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:27.302485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9011e-9cc7-484f-a19b-ae9b6e616144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.302766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 180/349] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:27.303430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9011e-9cc7-484f-a19b-ae9b6e616144 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.303708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9011e-9cc7-484f-a19b-ae9b6e616144 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.303891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785931-3779-48a6-b65b-a9f869d2b778 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.304068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9011e-9cc7-484f-a19b-ae9b6e616144 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.307604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785931-3779-48a6-b65b-a9f869d2b778 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.308014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785931-3779-48a6-b65b-a9f869d2b778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.310655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9011e-9cc7-484f-a19b-ae9b6e616144 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:27.312171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9011e-9cc7-484f-a19b-ae9b6e616144 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:27.314269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 170/350] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:27.315357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9011e-9cc7-484f-a19b-ae9b6e616144 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.334586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-06785931-3779-48a6-b65b-a9f869d2b778 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:27.335993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-06785931-3779-48a6-b65b-a9f869d2b778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:27.428196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 181/351] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:27.428976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06785931-3779-48a6-b65b-a9f869d2b778 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.477408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9011e-9cc7-484f-a19b-ae9b6e616144 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.516786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:27.525612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f31c-aa07-4198-893e-509b0b133445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.528494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f31c-aa07-4198-893e-509b0b133445 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.528494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f31c-aa07-4198-893e-509b0b133445 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.528494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f31c-aa07-4198-893e-509b0b133445 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.539393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0f31c-aa07-4198-893e-509b0b133445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d5c0f31c-aa07-4198-893e-509b0b133445 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:27.548495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:27.549402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:27.550186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:27.551285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 171/352] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:27.551350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f31c-aa07-4198-893e-509b0b133445 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.574051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06785931-3779-48a6-b65b-a9f869d2b778 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.600220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:27.619439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1a41b-7d46-4541-88dd-284121431dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.620884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1a41b-7d46-4541-88dd-284121431dbd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.620884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1a41b-7d46-4541-88dd-284121431dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.621070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1a41b-7d46-4541-88dd-284121431dbd None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.622212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1a41b-7d46-4541-88dd-284121431dbd None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:27.623663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1a41b-7d46-4541-88dd-284121431dbd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:27.625697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 182/353] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:27.626244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1a41b-7d46-4541-88dd-284121431dbd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.682731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f31c-aa07-4198-893e-509b0b133445 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.729808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e757f1f-b597-4695-8ba4-863d52321373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.730589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757f1f-b597-4695-8ba4-863d52321373 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.730874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757f1f-b597-4695-8ba4-863d52321373 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.731265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757f1f-b597-4695-8ba4-863d52321373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.732158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e757f1f-b597-4695-8ba4-863d52321373 None admin] RBAC: Adding query filter params (group.id=a90a490dbe3044e1956607093649ffab, role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=dac392a9fac04fbea9237070eefab8d7) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:27.732479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e757f1f-b597-4695-8ba4-863d52321373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:27.733954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e757f1f-b597-4695-8ba4-863d52321373 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:27.741962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 172/354] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/role_assignments?group.id=a90a490dbe3044e1956607093649ffab&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:27.741962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a1f5-22bb-4d67-a981-8e98896f6494 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.742178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a1f5-22bb-4d67-a981-8e98896f6494 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.742433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a1f5-22bb-4d67-a981-8e98896f6494 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.748281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 173/355] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:27.749270 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a1f5-22bb-4d67-a981-8e98896f6494 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.757141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1a41b-7d46-4541-88dd-284121431dbd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.795618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:27.801982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb756af-bff6-42ee-afb3-daa6236759b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.802997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb756af-bff6-42ee-afb3-daa6236759b2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.803344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb756af-bff6-42ee-afb3-daa6236759b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.803680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb756af-bff6-42ee-afb3-daa6236759b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.820333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb756af-bff6-42ee-afb3-daa6236759b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-5bb756af-bff6-42ee-afb3-daa6236759b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:27.830470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:27.831592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:22:27.832480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:27.836485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 183/356] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:27.838216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb756af-bff6-42ee-afb3-daa6236759b2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.904272 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:27.911195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a1f5-22bb-4d67-a981-8e98896f6494 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.957890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a66e98-6295-49f9-91c8-e14fd9500031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.958576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a66e98-6295-49f9-91c8-e14fd9500031 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.958974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a66e98-6295-49f9-91c8-e14fd9500031 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.959258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a66e98-6295-49f9-91c8-e14fd9500031 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.960055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a66e98-6295-49f9-91c8-e14fd9500031 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:27.960427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a66e98-6295-49f9-91c8-e14fd9500031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:27.961943 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a66e98-6295-49f9-91c8-e14fd9500031 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:27.971815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 174/357] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:27.973169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019888-63f2-4df4-b219-0b3e2fe32c8c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.973918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019888-63f2-4df4-b219-0b3e2fe32c8c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.973918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019888-63f2-4df4-b219-0b3e2fe32c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.991035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e4019888-63f2-4df4-b219-0b3e2fe32c8c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:27.992314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e4019888-63f2-4df4-b219-0b3e2fe32c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:27.993955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb756af-bff6-42ee-afb3-daa6236759b2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.036932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.037597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.037880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.038160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.039006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] RBAC: Adding query filter params (group.id=a90a490dbe3044e1956607093649ffab, role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=dac392a9fac04fbea9237070eefab8d7) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:28.039326 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.040820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.048010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 184/358] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/role_assignments?group.id=a90a490dbe3044e1956607093649ffab&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:28.048785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.087579 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 175/359] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:28.089258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584276d-b9a5-48fe-b87d-58622a314061 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.089553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584276d-b9a5-48fe-b87d-58622a314061 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.089834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584276d-b9a5-48fe-b87d-58622a314061 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.091114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 176/360] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:28.095166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584276d-b9a5-48fe-b87d-58622a314061 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.121551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.188352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaf119-6871-47d4-9a33-353ef4647216 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.231710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b5f00-d75f-49e7-8f02-1d1ceefa9362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.232626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b5f00-d75f-49e7-8f02-1d1ceefa9362 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.233030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b5f00-d75f-49e7-8f02-1d1ceefa9362 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.233323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b5f00-d75f-49e7-8f02-1d1ceefa9362 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.234170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b5f00-d75f-49e7-8f02-1d1ceefa9362 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:28.234567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b5f00-d75f-49e7-8f02-1d1ceefa9362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.236629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b5f00-d75f-49e7-8f02-1d1ceefa9362 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.240293 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.242473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584276d-b9a5-48fe-b87d-58622a314061 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.246858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 185/361] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:28.254241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6968-90dd-4961-9614-f952624bed00 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.254241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6968-90dd-4961-9614-f952624bed00 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.254241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb6968-90dd-4961-9614-f952624bed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.273709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-90fb6968-90dd-4961-9614-f952624bed00 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:28.275080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-90fb6968-90dd-4961-9614-f952624bed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:28.286278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f37059-fef4-4e43-a0c5-972a92c0dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.286940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f37059-fef4-4e43-a0c5-972a92c0dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.287225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f37059-fef4-4e43-a0c5-972a92c0dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.287499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f37059-fef4-4e43-a0c5-972a92c0dad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.373613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f37059-fef4-4e43-a0c5-972a92c0dad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.374997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f37059-fef4-4e43-a0c5-972a92c0dad6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.385286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 186/362] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:28.386188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb6968-90dd-4961-9614-f952624bed00 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.438021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.508887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb6968-90dd-4961-9614-f952624bed00 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.521441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 177/363] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:28.526566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f37059-fef4-4e43-a0c5-972a92c0dad6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.532248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.556555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ec5cd-a0ca-4217-8bbb-26b68910aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.557765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ec5cd-a0ca-4217-8bbb-26b68910aa8d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.558256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ec5cd-a0ca-4217-8bbb-26b68910aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.558734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ec5cd-a0ca-4217-8bbb-26b68910aa8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.572305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ec5cd-a0ca-4217-8bbb-26b68910aa8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a78ec5cd-a0ca-4217-8bbb-26b68910aa8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:28.582976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:28.584005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:28.584831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:28.587289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 187/364] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:28.588331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ec5cd-a0ca-4217-8bbb-26b68910aa8d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.644729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f37059-fef4-4e43-a0c5-972a92c0dad6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.680872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c55b1-3ffa-4a8f-b7ee-a47109c04b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.681756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c55b1-3ffa-4a8f-b7ee-a47109c04b34 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.682037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c55b1-3ffa-4a8f-b7ee-a47109c04b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.682312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c55b1-3ffa-4a8f-b7ee-a47109c04b34 None admin] PATH_INFO: `/v3/users/9f8978b221944c0aa5044578ec0dcc68` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.683515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c55b1-3ffa-4a8f-b7ee-a47109c04b34 None admin] RBAC: Authorizing `identity:get_user(user_id=9f8978b221944c0aa5044578ec0dcc68)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.685147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c55b1-3ffa-4a8f-b7ee-a47109c04b34 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.686827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 178/365] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/users/9f8978b221944c0aa5044578ec0dcc68 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:28.688669 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c55b1-3ffa-4a8f-b7ee-a47109c04b34 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.698067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ec5cd-a0ca-4217-8bbb-26b68910aa8d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.700276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.743003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5997-258c-4601-a6d7-ae99ce1a73fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.744219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5997-258c-4601-a6d7-ae99ce1a73fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.744716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5997-258c-4601-a6d7-ae99ce1a73fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.745187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5997-258c-4601-a6d7-ae99ce1a73fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.763332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb5997-258c-4601-a6d7-ae99ce1a73fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:28.764253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0dcb5997-258c-4601-a6d7-ae99ce1a73fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:28.771621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:28.772867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:28.773645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 188/366] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:28.778460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5997-258c-4601-a6d7-ae99ce1a73fc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.827790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c55b1-3ffa-4a8f-b7ee-a47109c04b34 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.876214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec1d0c-56ec-4ef8-b48d-e19ad027d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.877492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1d0c-56ec-4ef8-b48d-e19ad027d7da None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.878471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1d0c-56ec-4ef8-b48d-e19ad027d7da None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.878973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1d0c-56ec-4ef8-b48d-e19ad027d7da None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.880869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec1d0c-56ec-4ef8-b48d-e19ad027d7da None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.883311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec1d0c-56ec-4ef8-b48d-e19ad027d7da None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.886440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 179/367] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:28.887443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec1d0c-56ec-4ef8-b48d-e19ad027d7da None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.912336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5997-258c-4601-a6d7-ae99ce1a73fc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.973088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.974083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.976312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.976599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.978016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:28.978337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.980061 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.992375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 189/368] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:28.993588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.045022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.052900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec1d0c-56ec-4ef8-b48d-e19ad027d7da None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.093134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.100972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.102046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.102336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.102614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.103730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] RBAC: Adding query filter params (role.id=e9ba98fdb77f4aadae316c27d3e158ae, user.id=9f8978b221944c0aa5044578ec0dcc68, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:29.104076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.106845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.122498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 180/369] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/role_assignments?user.id=9f8978b221944c0aa5044578ec0dcc68&scope.system=all&role.id=e9ba98fdb77f4aadae316c27d3e158ae => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:29.126769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.178949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003f40b-2015-4eb8-a838-77b32995e386 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.257260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.257931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.258477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.259007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.259772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:29.260101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.261499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.282631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 190/370] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:29.283543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.324445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb3ff1-55d2-4d6f-aa26-6957e9d719b7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.387761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8bc07-fc80-4e17-b522-e7c242eb4051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.389005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8bc07-fc80-4e17-b522-e7c242eb4051 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.389490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8bc07-fc80-4e17-b522-e7c242eb4051 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.389996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8bc07-fc80-4e17-b522-e7c242eb4051 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.400696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8bc07-fc80-4e17-b522-e7c242eb4051 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.402461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8bc07-fc80-4e17-b522-e7c242eb4051 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.404407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 181/371] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:29.405407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8bc07-fc80-4e17-b522-e7c242eb4051 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.432622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.435025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe73e7d-8143-4637-9329-bc2f2ab1facf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.473783 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7b0b-dc2d-48e5-8b90-9fcfc2e3dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.474493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7b0b-dc2d-48e5-8b90-9fcfc2e3dfdb None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.474779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7b0b-dc2d-48e5-8b90-9fcfc2e3dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.475056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7b0b-dc2d-48e5-8b90-9fcfc2e3dfdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.540569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.554286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c7b0b-dc2d-48e5-8b90-9fcfc2e3dfdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.555809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c7b0b-dc2d-48e5-8b90-9fcfc2e3dfdb None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.590344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8bc07-fc80-4e17-b522-e7c242eb4051 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.625978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c067da-834f-4b75-9081-ab5fdfcc5c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.626665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c067da-834f-4b75-9081-ab5fdfcc5c8f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.626955 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c067da-834f-4b75-9081-ab5fdfcc5c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.627238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c067da-834f-4b75-9081-ab5fdfcc5c8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.647144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.663852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 191/372] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:29.664894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7b0b-dc2d-48e5-8b90-9fcfc2e3dfdb None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.699225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c067da-834f-4b75-9081-ab5fdfcc5c8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.700686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c067da-834f-4b75-9081-ab5fdfcc5c8f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.775974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7b0b-dc2d-48e5-8b90-9fcfc2e3dfdb None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.784310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.816115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 182/373] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:29.817254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c067da-834f-4b75-9081-ab5fdfcc5c8f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.821368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.822040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.822320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.822593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.823427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] RBAC: Adding query filter params (group.id=a90a490dbe3044e1956607093649ffab, role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=d21689e5ee72418fa4d0466bd95317f4) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:29.823735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.825966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.832921 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 192/374] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/role_assignments?group.id=a90a490dbe3044e1956607093649ffab&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:29.833805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.888939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.928573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c067da-834f-4b75-9081-ab5fdfcc5c8f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.943487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95f81-102a-4999-8aaa-d19db8e16a78 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.969791 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90083ae-e3a7-4796-b0fa-0c9d8dbfda3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.971567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90083ae-e3a7-4796-b0fa-0c9d8dbfda3d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.972691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90083ae-e3a7-4796-b0fa-0c9d8dbfda3d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.973137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90083ae-e3a7-4796-b0fa-0c9d8dbfda3d None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.974679 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90083ae-e3a7-4796-b0fa-0c9d8dbfda3d None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.976513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90083ae-e3a7-4796-b0fa-0c9d8dbfda3d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.978750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 183/375] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:29.987953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de848728-2f32-4553-a548-2641ae5edb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.988188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90083ae-e3a7-4796-b0fa-0c9d8dbfda3d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.988283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848728-2f32-4553-a548-2641ae5edb2a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.988283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848728-2f32-4553-a548-2641ae5edb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.988283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848728-2f32-4553-a548-2641ae5edb2a None admin] PATH_INFO: `/v3/projects/ef6352e5d076419cbaba12161ca4f129` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.988283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de848728-2f32-4553-a548-2641ae5edb2a None admin] RBAC: Authorizing `identity:get_project(project_id=ef6352e5d076419cbaba12161ca4f129)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.988582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de848728-2f32-4553-a548-2641ae5edb2a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.990088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 193/376] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/projects/ef6352e5d076419cbaba12161ca4f129 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:29.995847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de848728-2f32-4553-a548-2641ae5edb2a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.078690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.115052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de848728-2f32-4553-a548-2641ae5edb2a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.156602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.161990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff146e-1389-41bf-82ea-0482604ef39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.163800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff146e-1389-41bf-82ea-0482604ef39a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.164256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff146e-1389-41bf-82ea-0482604ef39a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.164692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff146e-1389-41bf-82ea-0482604ef39a None admin] PATH_INFO: `/v3/groups/11c2deff6c7c4fc3a923ccf7380349c1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.174698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff146e-1389-41bf-82ea-0482604ef39a None admin] RBAC: Authorizing `identity:get_group(group_id=11c2deff6c7c4fc3a923ccf7380349c1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.176410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff146e-1389-41bf-82ea-0482604ef39a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.179159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 194/377] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/groups/11c2deff6c7c4fc3a923ccf7380349c1 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:30.184910 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff146e-1389-41bf-82ea-0482604ef39a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.214908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90083ae-e3a7-4796-b0fa-0c9d8dbfda3d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.275189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1b3a-8d15-488c-b27f-958da86e21fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.276345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1b3a-8d15-488c-b27f-958da86e21fa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.276635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1b3a-8d15-488c-b27f-958da86e21fa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.276914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1b3a-8d15-488c-b27f-958da86e21fa None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.279024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c1b3a-8d15-488c-b27f-958da86e21fa None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.281228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c1b3a-8d15-488c-b27f-958da86e21fa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.284283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 184/378] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:30.290749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1b3a-8d15-488c-b27f-958da86e21fa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.332019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff146e-1389-41bf-82ea-0482604ef39a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.372658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b4c6e-47e9-4146-9cfc-6c2f685ceea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.373616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4c6e-47e9-4146-9cfc-6c2f685ceea1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.374044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4c6e-47e9-4146-9cfc-6c2f685ceea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.374473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b4c6e-47e9-4146-9cfc-6c2f685ceea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.375455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b4c6e-47e9-4146-9cfc-6c2f685ceea1 None admin] RBAC: Adding query filter params (group.id=11c2deff6c7c4fc3a923ccf7380349c1, role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=ef6352e5d076419cbaba12161ca4f129) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:30.375934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b4c6e-47e9-4146-9cfc-6c2f685ceea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.377766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b4c6e-47e9-4146-9cfc-6c2f685ceea1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.384851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 195/379] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/role_assignments?group.id=11c2deff6c7c4fc3a923ccf7380349c1&scope.project.id=ef6352e5d076419cbaba12161ca4f129&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:30.386336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046b99a-b2a2-47d3-b6d5-01248716e048 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.386768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046b99a-b2a2-47d3-b6d5-01248716e048 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.387189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046b99a-b2a2-47d3-b6d5-01248716e048 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.389215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 196/380] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:30.400648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.401736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b864d4-966b-4949-8883-b5e79a7c4492 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.402177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b864d4-966b-4949-8883-b5e79a7c4492 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.402618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b864d4-966b-4949-8883-b5e79a7c4492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.406553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1b3a-8d15-488c-b27f-958da86e21fa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.433607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-91b864d4-966b-4949-8883-b5e79a7c4492 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:30.435071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-91b864d4-966b-4949-8883-b5e79a7c4492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:30.448718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.449402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.449688 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.449969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.450821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] RBAC: Adding query filter params (group.id=a90a490dbe3044e1956607093649ffab, role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=d21689e5ee72418fa4d0466bd95317f4) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:30.451140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.452798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.460729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 185/381] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/role_assignments?group.id=a90a490dbe3044e1956607093649ffab&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:30.512304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.554671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 197/382] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:30.592193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.720872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48059c57-cbe5-4cd5-9f48-00a248eb070d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.771616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59e748-aee9-42a8-9b5b-02af5c64d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.772467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59e748-aee9-42a8-9b5b-02af5c64d832 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.772750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59e748-aee9-42a8-9b5b-02af5c64d832 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.773023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59e748-aee9-42a8-9b5b-02af5c64d832 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.792830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59e748-aee9-42a8-9b5b-02af5c64d832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8a59e748-aee9-42a8-9b5b-02af5c64d832 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:30.801322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:30.802185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:30.802975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:30.804061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 186/383] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:30.808723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b864d4-966b-4949-8883-b5e79a7c4492 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.842911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8248bb2-c3a6-4881-b333-1ac15f2863b3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.843262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8248bb2-c3a6-4881-b333-1ac15f2863b3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.843475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8248bb2-c3a6-4881-b333-1ac15f2863b3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.845080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 187/384] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:30.850466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6cc7-4230-4d99-b92c-c0004d752f4d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.850754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6cc7-4230-4d99-b92c-c0004d752f4d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.851036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6cc7-4230-4d99-b92c-c0004d752f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.879363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-509a6cc7-4230-4d99-b92c-c0004d752f4d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:30.880577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-509a6cc7-4230-4d99-b92c-c0004d752f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:30.899421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.925416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b864d4-966b-4949-8883-b5e79a7c4492 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.960624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.961567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.961994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.962413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.963308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:30.963774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.965312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.975097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 198/385] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:30.980861 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.007542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 188/386] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:31.029874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6cc7-4230-4d99-b92c-c0004d752f4d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.062774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:31.171478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6cc7-4230-4d99-b92c-c0004d752f4d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.178612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08db86c-3d23-4e78-9a76-26a5782f6ddd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.227219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819defe-0af5-4d60-8a1c-b2c6c8561c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.228466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819defe-0af5-4d60-8a1c-b2c6c8561c55 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.228970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819defe-0af5-4d60-8a1c-b2c6c8561c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.229451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819defe-0af5-4d60-8a1c-b2c6c8561c55 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.230837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819defe-0af5-4d60-8a1c-b2c6c8561c55 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.232530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819defe-0af5-4d60-8a1c-b2c6c8561c55 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.236934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 199/387] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:31.242920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819defe-0af5-4d60-8a1c-b2c6c8561c55 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.254207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf68017-4968-46ec-bfb9-e5f1c79d0414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.255371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68017-4968-46ec-bfb9-e5f1c79d0414 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.257445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68017-4968-46ec-bfb9-e5f1c79d0414 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.257927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68017-4968-46ec-bfb9-e5f1c79d0414 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.284435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf68017-4968-46ec-bfb9-e5f1c79d0414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-faf68017-4968-46ec-bfb9-e5f1c79d0414 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:31.296610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:31.297502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:31.298335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:31.306398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 189/388] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:31.312382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf68017-4968-46ec-bfb9-e5f1c79d0414 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.332343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:31.447429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819defe-0af5-4d60-8a1c-b2c6c8561c55 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.461776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:31.509474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3b2d9-ba13-486c-9595-5e062057a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.509700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf68017-4968-46ec-bfb9-e5f1c79d0414 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.510924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3b2d9-ba13-486c-9595-5e062057a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.511298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3b2d9-ba13-486c-9595-5e062057a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.511669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3b2d9-ba13-486c-9595-5e062057a2c5 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.516688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3b2d9-ba13-486c-9595-5e062057a2c5 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.518939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3b2d9-ba13-486c-9595-5e062057a2c5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.521236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 200/389] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:31.527092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3b2d9-ba13-486c-9595-5e062057a2c5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.556246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.557206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.558085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.558522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.559597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:31.560261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.562034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.577359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 190/390] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:31.583305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.680726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:31.699628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3b2d9-ba13-486c-9595-5e062057a2c5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.725318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aec008-3f4f-44d1-8c6e-82493abfa33e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.769191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088bd2-c24d-4299-b4e6-d98949bf1a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.770282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088bd2-c24d-4299-b4e6-d98949bf1a2c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.770571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088bd2-c24d-4299-b4e6-d98949bf1a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.770894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80088bd2-c24d-4299-b4e6-d98949bf1a2c None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.772094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80088bd2-c24d-4299-b4e6-d98949bf1a2c None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.773103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6eafd-47af-47f2-ae9e-3f88c79d3be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.773635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80088bd2-c24d-4299-b4e6-d98949bf1a2c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.773986 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6eafd-47af-47f2-ae9e-3f88c79d3be0 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.774264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6eafd-47af-47f2-ae9e-3f88c79d3be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.774536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6eafd-47af-47f2-ae9e-3f88c79d3be0 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7/groups/a90a490dbe3044e1956607093649ffab/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.775669 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 191/391] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:31.777269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6eafd-47af-47f2-ae9e-3f88c79d3be0 None admin] RBAC: Authorizing `identity:create_grant(project_id=dac392a9fac04fbea9237070eefab8d7, group_id=a90a490dbe3044e1956607093649ffab, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.778707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6eafd-47af-47f2-ae9e-3f88c79d3be0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.781185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088bd2-c24d-4299-b4e6-d98949bf1a2c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.868628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 201/392] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jun 15 00:22:31 2022] PUT /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7/groups/a90a490dbe3044e1956607093649ffab/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:22:31.904071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80088bd2-c24d-4299-b4e6-d98949bf1a2c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.944574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620b939-843e-4634-acd6-5d0dac437152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.945481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620b939-843e-4634-acd6-5d0dac437152 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.945766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620b939-843e-4634-acd6-5d0dac437152 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.946041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620b939-843e-4634-acd6-5d0dac437152 None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.947278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620b939-843e-4634-acd6-5d0dac437152 None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.951110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620b939-843e-4634-acd6-5d0dac437152 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.953379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 192/393] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:31.959653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6eafd-47af-47f2-ae9e-3f88c79d3be0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.999547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:32.082411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6eafd-47af-47f2-ae9e-3f88c79d3be0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.128800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30163d46-e603-4a6b-8ec6-cafed90df36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.129589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30163d46-e603-4a6b-8ec6-cafed90df36d None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.129871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30163d46-e603-4a6b-8ec6-cafed90df36d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.130148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30163d46-e603-4a6b-8ec6-cafed90df36d None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7/groups/a90a490dbe3044e1956607093649ffab/roles/414930bf02ef4277b0b66bc57f1f1628` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.132516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30163d46-e603-4a6b-8ec6-cafed90df36d None admin] RBAC: Authorizing `identity:create_grant(project_id=dac392a9fac04fbea9237070eefab8d7, group_id=a90a490dbe3044e1956607093649ffab, role_id=414930bf02ef4277b0b66bc57f1f1628)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:32.134226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30163d46-e603-4a6b-8ec6-cafed90df36d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:32.222275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 202/394] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jun 15 00:22:31 2022] PUT /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7/groups/a90a490dbe3044e1956607093649ffab/roles/414930bf02ef4277b0b66bc57f1f1628 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:32.675959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9b5c5-4d47-45a1-a998-d388044be628 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.676662 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9b5c5-4d47-45a1-a998-d388044be628 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.677165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9b5c5-4d47-45a1-a998-d388044be628 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.678962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 193/395] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:32.684631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66423d08-29ea-49d4-ac78-ae86bbf8b662 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.685172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66423d08-29ea-49d4-ac78-ae86bbf8b662 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.685649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66423d08-29ea-49d4-ac78-ae86bbf8b662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.704221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-66423d08-29ea-49d4-ac78-ae86bbf8b662 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:32.706361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-66423d08-29ea-49d4-ac78-ae86bbf8b662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:32.780835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 203/396] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:32.805245 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9b5c5-4d47-45a1-a998-d388044be628 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:32.808229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:32.933232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9b5c5-4d47-45a1-a998-d388044be628 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.975444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82389caf-fe66-416b-bd30-9db6bf4eb223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.976283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389caf-fe66-416b-bd30-9db6bf4eb223 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.976564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389caf-fe66-416b-bd30-9db6bf4eb223 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.976837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82389caf-fe66-416b-bd30-9db6bf4eb223 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.991046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82389caf-fe66-416b-bd30-9db6bf4eb223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-82389caf-fe66-416b-bd30-9db6bf4eb223 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:32.998865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:32.999745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:33.000602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:33.004517 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 194/397] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:33.013084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66423d08-29ea-49d4-ac78-ae86bbf8b662 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.059387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.171395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66423d08-29ea-49d4-ac78-ae86bbf8b662 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.178803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3863-c04c-478a-9b51-03026b36dc89 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.179392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3863-c04c-478a-9b51-03026b36dc89 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.179901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3863-c04c-478a-9b51-03026b36dc89 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.181519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 195/398] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:33.189717 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e28b-5de2-4536-96d1-50aee2877983 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.190265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e28b-5de2-4536-96d1-50aee2877983 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.190757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e28b-5de2-4536-96d1-50aee2877983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.207803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b9a4e28b-5de2-4536-96d1-50aee2877983 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:33.209306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9a4e28b-5de2-4536-96d1-50aee2877983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:33.217528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.218203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.218484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.218759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.219517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:33.219823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.221869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.240593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 204/399] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:33.246524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.301671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.315408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 196/400] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:33.384574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.391958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e28b-5de2-4536-96d1-50aee2877983 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.404457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758ac7c-c492-44ab-ab9e-39fa132a3e9f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.439260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd6d9-f5a8-4850-97f7-da7705d85b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.440197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd6d9-f5a8-4850-97f7-da7705d85b26 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.440423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd6d9-f5a8-4850-97f7-da7705d85b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.440697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bd6d9-f5a8-4850-97f7-da7705d85b26 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.441881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd6d9-f5a8-4850-97f7-da7705d85b26 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.443859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bd6d9-f5a8-4850-97f7-da7705d85b26 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.446353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 205/401] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:33.451628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd6d9-f5a8-4850-97f7-da7705d85b26 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.591565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bd6d9-f5a8-4850-97f7-da7705d85b26 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.593343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e28b-5de2-4536-96d1-50aee2877983 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.626716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2e68-c907-464b-ae24-cab15797d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.627953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2e68-c907-464b-ae24-cab15797d96f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.628399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2e68-c907-464b-ae24-cab15797d96f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.628810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2e68-c907-464b-ae24-cab15797d96f None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.630167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c2e68-c907-464b-ae24-cab15797d96f None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.631771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c2e68-c907-464b-ae24-cab15797d96f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.634143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 206/402] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:33.635951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48a49-b528-4de9-a41b-70cf7948a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.636296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48a49-b528-4de9-a41b-70cf7948a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.636784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48a49-b528-4de9-a41b-70cf7948a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.637203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48a49-b528-4de9-a41b-70cf7948a0a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.639978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98210-096d-4728-8b5a-3c55b44a812c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.640452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98210-096d-4728-8b5a-3c55b44a812c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.640877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec98210-096d-4728-8b5a-3c55b44a812c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.642791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 207/403] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:33.643598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec98210-096d-4728-8b5a-3c55b44a812c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.656724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d48a49-b528-4de9-a41b-70cf7948a0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d3d48a49-b528-4de9-a41b-70cf7948a0a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:33.666870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:33.668023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:33.668998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 197/404] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:33.669669 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13978-0cce-4f83-a352-29352fc091a0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.669965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13978-0cce-4f83-a352-29352fc091a0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.670678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13978-0cce-4f83-a352-29352fc091a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.674086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.696239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f0f13978-0cce-4f83-a352-29352fc091a0 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:33.697639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f0f13978-0cce-4f83-a352-29352fc091a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:33.758924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec98210-096d-4728-8b5a-3c55b44a812c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.759146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.779840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 198/405] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:33.781844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13978-0cce-4f83-a352-29352fc091a0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.794012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb81a5-f1e3-4d4a-a6d2-e1d751855446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.795143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb81a5-f1e3-4d4a-a6d2-e1d751855446 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.795592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb81a5-f1e3-4d4a-a6d2-e1d751855446 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.796030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb81a5-f1e3-4d4a-a6d2-e1d751855446 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4/groups/a90a490dbe3044e1956607093649ffab/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.798673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb81a5-f1e3-4d4a-a6d2-e1d751855446 None admin] RBAC: Authorizing `identity:create_grant(project_id=d21689e5ee72418fa4d0466bd95317f4, group_id=a90a490dbe3044e1956607093649ffab, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.800410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb81a5-f1e3-4d4a-a6d2-e1d751855446 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.869461 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 208/406] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jun 15 00:22:33 2022] PUT /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4/groups/a90a490dbe3044e1956607093649ffab/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:33.870607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb81a5-f1e3-4d4a-a6d2-e1d751855446 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.932658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13978-0cce-4f83-a352-29352fc091a0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.994671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.016300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb81a5-f1e3-4d4a-a6d2-e1d751855446 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.040542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.041331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.041790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.042211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.043142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:34.043594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.045186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.056317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625610-ca93-4328-b84c-ee1d8bc4f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.057239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625610-ca93-4328-b84c-ee1d8bc4f645 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.057516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625610-ca93-4328-b84c-ee1d8bc4f645 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.057786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0625610-ca93-4328-b84c-ee1d8bc4f645 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.061711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 199/407] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:34.069040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.078766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0625610-ca93-4328-b84c-ee1d8bc4f645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f0625610-ca93-4328-b84c-ee1d8bc4f645 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:34.087654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:34.090892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:34.091672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 209/408] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:34.097240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625610-ca93-4328-b84c-ee1d8bc4f645 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.133828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.194174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea34bd-a18e-4514-9ac7-53120d93f8cc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.207882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0625610-ca93-4328-b84c-ee1d8bc4f645 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.232395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e1c00-2528-4224-8b6a-caa1dc63a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.233613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1c00-2528-4224-8b6a-caa1dc63a5aa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.234039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1c00-2528-4224-8b6a-caa1dc63a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.234453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e1c00-2528-4224-8b6a-caa1dc63a5aa None admin] PATH_INFO: `/v3/groups/11c2deff6c7c4fc3a923ccf7380349c1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.236438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e1c00-2528-4224-8b6a-caa1dc63a5aa None admin] RBAC: Authorizing `identity:get_group(group_id=11c2deff6c7c4fc3a923ccf7380349c1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.238143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e1c00-2528-4224-8b6a-caa1dc63a5aa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.240502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 200/409] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/groups/11c2deff6c7c4fc3a923ccf7380349c1 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:34.247509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.248702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e1c00-2528-4224-8b6a-caa1dc63a5aa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.249779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.250539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.255084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.261279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:34.261755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.263302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.281232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 210/410] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:34.286273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.291683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.402003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e1c00-2528-4224-8b6a-caa1dc63a5aa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.416783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.439104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8226-602d-45dd-9017-f665a54da14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.440264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8226-602d-45dd-9017-f665a54da14e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.440707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8226-602d-45dd-9017-f665a54da14e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.441270 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8226-602d-45dd-9017-f665a54da14e None admin] PATH_INFO: `/v3/projects/ef6352e5d076419cbaba12161ca4f129` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.442489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8226-602d-45dd-9017-f665a54da14e None admin] RBAC: Authorizing `identity:get_project(project_id=ef6352e5d076419cbaba12161ca4f129)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.444891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8226-602d-45dd-9017-f665a54da14e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.446616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 201/411] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/projects/ef6352e5d076419cbaba12161ca4f129 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:34.447964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c388-9f9b-4072-a068-702facdc92a8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.448448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c388-9f9b-4072-a068-702facdc92a8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.448886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c388-9f9b-4072-a068-702facdc92a8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.450537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 202/412] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:34.452119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4c388-9f9b-4072-a068-702facdc92a8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.464117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04916e-959e-489e-ade0-8d63fa452200 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.501775 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a957f-294d-4850-944d-8c1e26226165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.503055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a957f-294d-4850-944d-8c1e26226165 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.503567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a957f-294d-4850-944d-8c1e26226165 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.504083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a957f-294d-4850-944d-8c1e26226165 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.505567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a957f-294d-4850-944d-8c1e26226165 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.507207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a957f-294d-4850-944d-8c1e26226165 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.509765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 211/413] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:34.511307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8565-0920-4d5b-a5b0-10be084c951a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.511842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8565-0920-4d5b-a5b0-10be084c951a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.512355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8565-0920-4d5b-a5b0-10be084c951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.532443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-708d8565-0920-4d5b-a5b0-10be084c951a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:34.534710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-708d8565-0920-4d5b-a5b0-10be084c951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:34.584475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4c388-9f9b-4072-a068-702facdc92a8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.613055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 212/414] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:34.614275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d8565-0920-4d5b-a5b0-10be084c951a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.616941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.647075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f59c-0b56-4487-9228-4f7c2c8d566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.647996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f59c-0b56-4487-9228-4f7c2c8d566b None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.648283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f59c-0b56-4487-9228-4f7c2c8d566b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.648571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f59c-0b56-4487-9228-4f7c2c8d566b None admin] PATH_INFO: `/v3/projects/ef6352e5d076419cbaba12161ca4f129/groups/11c2deff6c7c4fc3a923ccf7380349c1/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.650560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081f59c-0b56-4487-9228-4f7c2c8d566b None admin] RBAC: Authorizing `identity:create_grant(project_id=ef6352e5d076419cbaba12161ca4f129, group_id=11c2deff6c7c4fc3a923ccf7380349c1, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.652052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081f59c-0b56-4487-9228-4f7c2c8d566b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.732075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 203/415] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jun 15 00:22:34 2022] PUT /identity/v3/projects/ef6352e5d076419cbaba12161ca4f129/groups/11c2deff6c7c4fc3a923ccf7380349c1/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:22:34.732075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f59c-0b56-4487-9228-4f7c2c8d566b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.736547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d8565-0920-4d5b-a5b0-10be084c951a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.830532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb4eca-4801-469b-b96a-97e5e133155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.831417 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb4eca-4801-469b-b96a-97e5e133155f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.831697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb4eca-4801-469b-b96a-97e5e133155f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.831991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb4eca-4801-469b-b96a-97e5e133155f None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.833985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb4eca-4801-469b-b96a-97e5e133155f None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.835471 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb4eca-4801-469b-b96a-97e5e133155f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.840274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.840926 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 213/416] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:34.847583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb4eca-4801-469b-b96a-97e5e133155f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.933426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f59c-0b56-4487-9228-4f7c2c8d566b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.963571 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.975444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977e1d0-6c17-4e89-9575-a5977b93301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.978569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977e1d0-6c17-4e89-9575-a5977b93301b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.978569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977e1d0-6c17-4e89-9575-a5977b93301b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.978569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977e1d0-6c17-4e89-9575-a5977b93301b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.990211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977e1d0-6c17-4e89-9575-a5977b93301b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0977e1d0-6c17-4e89-9575-a5977b93301b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:34.999366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:35.000374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:35.001164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:35.002402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb4eca-4801-469b-b96a-97e5e133155f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.005587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 204/417] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:35.012059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977e1d0-6c17-4e89-9575-a5977b93301b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.048850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88c55a-80a9-45f3-bd3b-9a6e089b09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.049896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88c55a-80a9-45f3-bd3b-9a6e089b09e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.050109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88c55a-80a9-45f3-bd3b-9a6e089b09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.050427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88c55a-80a9-45f3-bd3b-9a6e089b09e1 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4/groups/a90a490dbe3044e1956607093649ffab/roles/414930bf02ef4277b0b66bc57f1f1628` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.052827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88c55a-80a9-45f3-bd3b-9a6e089b09e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d21689e5ee72418fa4d0466bd95317f4, group_id=a90a490dbe3044e1956607093649ffab, role_id=414930bf02ef4277b0b66bc57f1f1628)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.054424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88c55a-80a9-45f3-bd3b-9a6e089b09e1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.119159 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.122268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977e1d0-6c17-4e89-9575-a5977b93301b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.155106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecd8eb-be2e-41c0-a982-923302dd193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.155775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecd8eb-be2e-41c0-a982-923302dd193d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.156090 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecd8eb-be2e-41c0-a982-923302dd193d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.156363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecd8eb-be2e-41c0-a982-923302dd193d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.157146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecd8eb-be2e-41c0-a982-923302dd193d None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:35.157467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecd8eb-be2e-41c0-a982-923302dd193d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.158848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecd8eb-be2e-41c0-a982-923302dd193d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.167183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 205/418] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:35.171971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975db09-5ace-4b64-961e-42346de22209 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.171971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975db09-5ace-4b64-961e-42346de22209 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.171971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975db09-5ace-4b64-961e-42346de22209 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.171971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 206/419] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:35.173964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975db09-5ace-4b64-961e-42346de22209 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.186026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 214/420] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jun 15 00:22:34 2022] PUT /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4/groups/a90a490dbe3044e1956607093649ffab/roles/414930bf02ef4277b0b66bc57f1f1628 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:35.194369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a37097-455b-4d63-a664-9b84e53e18ff None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.194756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a37097-455b-4d63-a664-9b84e53e18ff None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.195125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a37097-455b-4d63-a664-9b84e53e18ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.225310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a6a37097-455b-4d63-a664-9b84e53e18ff None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:35.227410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a6a37097-455b-4d63-a664-9b84e53e18ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:35.340150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 215/421] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:35.367562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a37097-455b-4d63-a664-9b84e53e18ff None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.367800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975db09-5ace-4b64-961e-42346de22209 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.412980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052778-a35e-4836-a536-c65d36a26f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.413553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052778-a35e-4836-a536-c65d36a26f50 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.413842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052778-a35e-4836-a536-c65d36a26f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.414115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052778-a35e-4836-a536-c65d36a26f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.452889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.455546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.499361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a37097-455b-4d63-a664-9b84e53e18ff None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.505860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052778-a35e-4836-a536-c65d36a26f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.507727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052778-a35e-4836-a536-c65d36a26f50 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.559682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e215ca2-22a4-47fa-9886-4e158b2b9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.560777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215ca2-22a4-47fa-9886-4e158b2b9b0c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.561378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215ca2-22a4-47fa-9886-4e158b2b9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.562423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215ca2-22a4-47fa-9886-4e158b2b9b0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.585307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e215ca2-22a4-47fa-9886-4e158b2b9b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7e215ca2-22a4-47fa-9886-4e158b2b9b0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:35.593728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:35.594767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:35.596281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:35.598614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 216/422] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:35.605059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e215ca2-22a4-47fa-9886-4e158b2b9b0c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.657743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 207/423] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:35.663385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052778-a35e-4836-a536-c65d36a26f50 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.760291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.777320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e215ca2-22a4-47fa-9886-4e158b2b9b0c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.804316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.813633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.814860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.815148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.815424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.816345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:35.816663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.818047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.827520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 217/424] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:35.833195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.834313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052778-a35e-4836-a536-c65d36a26f50 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.896454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae96192-c6ad-4a29-9a06-06e6eb93314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.897410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae96192-c6ad-4a29-9a06-06e6eb93314c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.897694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae96192-c6ad-4a29-9a06-06e6eb93314c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.897968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae96192-c6ad-4a29-9a06-06e6eb93314c None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.900684 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae96192-c6ad-4a29-9a06-06e6eb93314c None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.902147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae96192-c6ad-4a29-9a06-06e6eb93314c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.908058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 208/425] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:35.909271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae96192-c6ad-4a29-9a06-06e6eb93314c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.935214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d409c-c674-404e-87e6-8f6e37844583 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.969859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26567057-dec4-4299-87c6-7c3a38f9ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.971026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26567057-dec4-4299-87c6-7c3a38f9ab40 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.971317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26567057-dec4-4299-87c6-7c3a38f9ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.971595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26567057-dec4-4299-87c6-7c3a38f9ab40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.032280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.044832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26567057-dec4-4299-87c6-7c3a38f9ab40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.046621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26567057-dec4-4299-87c6-7c3a38f9ab40 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.124760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae96192-c6ad-4a29-9a06-06e6eb93314c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.164845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 218/426] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:22:36.175392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26567057-dec4-4299-87c6-7c3a38f9ab40 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.199979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.208767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80597d-d1ba-4550-9cbd-66e2f9bc15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.209643 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80597d-d1ba-4550-9cbd-66e2f9bc15a2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.209927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80597d-d1ba-4550-9cbd-66e2f9bc15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.212185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80597d-d1ba-4550-9cbd-66e2f9bc15a2 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.212185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80597d-d1ba-4550-9cbd-66e2f9bc15a2 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.214565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80597d-d1ba-4550-9cbd-66e2f9bc15a2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.216488 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 209/427] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:36.222228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80597d-d1ba-4550-9cbd-66e2f9bc15a2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.336281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.371767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26567057-dec4-4299-87c6-7c3a38f9ab40 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.447046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80597d-d1ba-4550-9cbd-66e2f9bc15a2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.459629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76904af4-9434-4503-bdd3-283a2d2ff91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.460450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904af4-9434-4503-bdd3-283a2d2ff91b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.460734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904af4-9434-4503-bdd3-283a2d2ff91b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.461011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904af4-9434-4503-bdd3-283a2d2ff91b None admin] PATH_INFO: `/v3/projects/dac392a9fac04fbea9237070eefab8d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.462214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76904af4-9434-4503-bdd3-283a2d2ff91b None admin] RBAC: Authorizing `identity:get_project(project_id=dac392a9fac04fbea9237070eefab8d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.463674 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76904af4-9434-4503-bdd3-283a2d2ff91b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.467484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 219/428] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/projects/dac392a9fac04fbea9237070eefab8d7 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:36.482163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303a6e-c7c1-4768-b59e-2ca9fb30e822 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.482450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303a6e-c7c1-4768-b59e-2ca9fb30e822 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.482732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303a6e-c7c1-4768-b59e-2ca9fb30e822 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.484712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 220/429] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:36.485434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90303a6e-c7c1-4768-b59e-2ca9fb30e822 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.503356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdaa15-2d75-4c33-9bf4-db313de8053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.504453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdaa15-2d75-4c33-9bf4-db313de8053c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.505014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdaa15-2d75-4c33-9bf4-db313de8053c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.505479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdaa15-2d75-4c33-9bf4-db313de8053c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.506580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdaa15-2d75-4c33-9bf4-db313de8053c None admin] RBAC: Adding query filter params (group.id=a90a490dbe3044e1956607093649ffab, role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=dac392a9fac04fbea9237070eefab8d7) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:36.507215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdaa15-2d75-4c33-9bf4-db313de8053c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.509170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdaa15-2d75-4c33-9bf4-db313de8053c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.516033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 210/430] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/role_assignments?group.id=a90a490dbe3044e1956607093649ffab&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 611 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:36.517712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cc142-0279-485b-ac37-dd9c2ea1d180 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.518214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cc142-0279-485b-ac37-dd9c2ea1d180 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.518781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cc142-0279-485b-ac37-dd9c2ea1d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.549607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-330cc142-0279-485b-ac37-dd9c2ea1d180 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:36.550855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-330cc142-0279-485b-ac37-dd9c2ea1d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:36.608853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90303a6e-c7c1-4768-b59e-2ca9fb30e822 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.650665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14749e-113a-48e2-91dc-abf9259456a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.651534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14749e-113a-48e2-91dc-abf9259456a4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.651817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14749e-113a-48e2-91dc-abf9259456a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.652134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14749e-113a-48e2-91dc-abf9259456a4 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.653783 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14749e-113a-48e2-91dc-abf9259456a4 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.655258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14749e-113a-48e2-91dc-abf9259456a4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.657242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 221/431] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:36.664615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14749e-113a-48e2-91dc-abf9259456a4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.688409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.696987 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.708104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 211/432] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:36.733173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cc142-0279-485b-ac37-dd9c2ea1d180 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.805723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14749e-113a-48e2-91dc-abf9259456a4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.851578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.851780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cc142-0279-485b-ac37-dd9c2ea1d180 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.852268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.852552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.852827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.853668 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] RBAC: Adding query filter params (group.id=a90a490dbe3044e1956607093649ffab, role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=dac392a9fac04fbea9237070eefab8d7) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:36.853983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.856487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.863586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 222/433] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/role_assignments?group.id=a90a490dbe3044e1956607093649ffab&scope.project.id=dac392a9fac04fbea9237070eefab8d7&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:36.894090 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426ef8-4b1c-4410-bb5a-edc39767479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.895220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426ef8-4b1c-4410-bb5a-edc39767479d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.895718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426ef8-4b1c-4410-bb5a-edc39767479d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.896199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426ef8-4b1c-4410-bb5a-edc39767479d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.909075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13426ef8-4b1c-4410-bb5a-edc39767479d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-13426ef8-4b1c-4410-bb5a-edc39767479d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:36.917330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:36.918280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:22:36.919073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:36.921549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 212/434] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:36.929024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.039388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.061151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae91726-a128-4772-a6e9-ae04bc090dc3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.102614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaa1da-b1e7-498b-b337-262bcea71e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.103284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa1da-b1e7-498b-b337-262bcea71e23 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.103570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa1da-b1e7-498b-b337-262bcea71e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.103844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa1da-b1e7-498b-b337-262bcea71e23 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.104685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaa1da-b1e7-498b-b337-262bcea71e23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:37.104997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaa1da-b1e7-498b-b337-262bcea71e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.106368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaa1da-b1e7-498b-b337-262bcea71e23 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.116258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 223/435] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:37.121725 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426ef8-4b1c-4410-bb5a-edc39767479d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.185878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.238839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426ef8-4b1c-4410-bb5a-edc39767479d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.278951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74187d-1dfc-4496-830a-cd039f53d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.279988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74187d-1dfc-4496-830a-cd039f53d93c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.280491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74187d-1dfc-4496-830a-cd039f53d93c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.280973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74187d-1dfc-4496-830a-cd039f53d93c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.318533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2bc4-c063-4a43-9b57-ca276f53f62a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.319426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2bc4-c063-4a43-9b57-ca276f53f62a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.319966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2bc4-c063-4a43-9b57-ca276f53f62a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.322259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 224/436] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:37.329253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510edd82-e844-4105-bd7b-45ca2708b88b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.330437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510edd82-e844-4105-bd7b-45ca2708b88b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.331014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510edd82-e844-4105-bd7b-45ca2708b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.355591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74187d-1dfc-4496-830a-cd039f53d93c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.357094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74187d-1dfc-4496-830a-cd039f53d93c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.359111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-510edd82-e844-4105-bd7b-45ca2708b88b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:37.360475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-510edd82-e844-4105-bd7b-45ca2708b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:37.429074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.461607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 225/437] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:37.487773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510edd82-e844-4105-bd7b-45ca2708b88b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.491780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 213/438] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:37.496778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74187d-1dfc-4496-830a-cd039f53d93c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.584025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.612632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510edd82-e844-4105-bd7b-45ca2708b88b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.618165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74187d-1dfc-4496-830a-cd039f53d93c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.649325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb650af-8be9-4d92-8d32-e354754a66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.650111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb650af-8be9-4d92-8d32-e354754a66ca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.650391 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb650af-8be9-4d92-8d32-e354754a66ca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.650665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb650af-8be9-4d92-8d32-e354754a66ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.659630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b9e3a-cb2f-44b9-83c4-0167f1617509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.660509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9e3a-cb2f-44b9-83c4-0167f1617509 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.660789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9e3a-cb2f-44b9-83c4-0167f1617509 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.661109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9e3a-cb2f-44b9-83c4-0167f1617509 None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.661334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb650af-8be9-4d92-8d32-e354754a66ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:37.662265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b9e3a-cb2f-44b9-83c4-0167f1617509 None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.663693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b9e3a-cb2f-44b9-83c4-0167f1617509 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.665387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 214/439] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:37.666510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440995-1515-4be5-bb3d-93e300dd1a84 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.666788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440995-1515-4be5-bb3d-93e300dd1a84 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.667109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de440995-1515-4be5-bb3d-93e300dd1a84 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.668449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 215/440] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8fb650af-8be9-4d92-8d32-e354754a66ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:37.668854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:37.669672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:37.670452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:37.671139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de440995-1515-4be5-bb3d-93e300dd1a84 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.672465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 226/441] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:37.674272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d1625-1190-4b7c-8277-55921903b91b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.674556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d1625-1190-4b7c-8277-55921903b91b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.674893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d1625-1190-4b7c-8277-55921903b91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.690994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1b6d1625-1190-4b7c-8277-55921903b91b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:37.692220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1b6d1625-1190-4b7c-8277-55921903b91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:37.693452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.759070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 227/442] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:37.759922 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d1625-1190-4b7c-8277-55921903b91b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.774233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de440995-1515-4be5-bb3d-93e300dd1a84 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.808141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf199-7e73-4cc7-83ea-88fcacf90225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.808981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf199-7e73-4cc7-83ea-88fcacf90225 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.809263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf199-7e73-4cc7-83ea-88fcacf90225 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.809537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecf199-7e73-4cc7-83ea-88fcacf90225 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.810687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecf199-7e73-4cc7-83ea-88fcacf90225 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.812130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecf199-7e73-4cc7-83ea-88fcacf90225 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.813745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 216/443] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:37.816788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf199-7e73-4cc7-83ea-88fcacf90225 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.822570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.860039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d1625-1190-4b7c-8277-55921903b91b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.893345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.894001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.894285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.894559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.895333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:37.895640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.897059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.901348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.905167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 228/444] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:37.905939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.914119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecf199-7e73-4cc7-83ea-88fcacf90225 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.948270 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be752b-9324-4f4e-87fc-41f2d08ba752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.949067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be752b-9324-4f4e-87fc-41f2d08ba752 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.949344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be752b-9324-4f4e-87fc-41f2d08ba752 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.949621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be752b-9324-4f4e-87fc-41f2d08ba752 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.959872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be752b-9324-4f4e-87fc-41f2d08ba752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-07be752b-9324-4f4e-87fc-41f2d08ba752 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:37.967927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:37.968816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:37.969636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 217/445] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:37.970944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be752b-9324-4f4e-87fc-41f2d08ba752 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.006884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4765bd-0be0-4b42-9425-cf70b66e345a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.031661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.040686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.041327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.041608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.041881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.042698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] RBAC: Adding query filter params (group.id=a90a490dbe3044e1956607093649ffab, role.id=a7a423c4a93a47adb277eb4b35903b4c, scope.project.id=d21689e5ee72418fa4d0466bd95317f4) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:38.043007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.044485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.050068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 229/446] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/role_assignments?group.id=a90a490dbe3044e1956607093649ffab&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=a7a423c4a93a47adb277eb4b35903b4c => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:38.050833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.071077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be752b-9324-4f4e-87fc-41f2d08ba752 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.117758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f3cf-dbdf-4aa5-8fd5-36c8c09e0dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.118612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f3cf-dbdf-4aa5-8fd5-36c8c09e0dac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.118902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f3cf-dbdf-4aa5-8fd5-36c8c09e0dac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.119181 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f3cf-dbdf-4aa5-8fd5-36c8c09e0dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.144867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.176266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a487f5-6331-4b2a-8fd6-678a507ecb8d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.210516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119f3cf-dbdf-4aa5-8fd5-36c8c09e0dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.212005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119f3cf-dbdf-4aa5-8fd5-36c8c09e0dac None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.213435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.214372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.214372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.215388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.215388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:38.215671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.217053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.226215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 230/447] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:38.231312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.290975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.339459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 218/448] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:38.344198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f3cf-dbdf-4aa5-8fd5-36c8c09e0dac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.346610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7d8da-965f-4624-9c95-e462d66cbe7d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.393691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84694dec-31b2-4c4d-88d0-f704956f7b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.394265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84694dec-31b2-4c4d-88d0-f704956f7b34 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.394558 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84694dec-31b2-4c4d-88d0-f704956f7b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.395413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84694dec-31b2-4c4d-88d0-f704956f7b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.402525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.462222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f3cf-dbdf-4aa5-8fd5-36c8c09e0dac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.466085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84694dec-31b2-4c4d-88d0-f704956f7b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.467529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84694dec-31b2-4c4d-88d0-f704956f7b34 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.494971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d62fa-ff32-446c-a13f-f083b55b5581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.495832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d62fa-ff32-446c-a13f-f083b55b5581 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.496142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d62fa-ff32-446c-a13f-f083b55b5581 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.496423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d62fa-ff32-446c-a13f-f083b55b5581 None admin] PATH_INFO: `/v3/projects/ef6352e5d076419cbaba12161ca4f129` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.497599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d62fa-ff32-446c-a13f-f083b55b5581 None admin] RBAC: Authorizing `identity:get_project(project_id=ef6352e5d076419cbaba12161ca4f129)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.499025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d62fa-ff32-446c-a13f-f083b55b5581 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.500728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 219/449] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/projects/ef6352e5d076419cbaba12161ca4f129 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:38.506475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d62fa-ff32-446c-a13f-f083b55b5581 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.518245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.564906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 231/450] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:38.570311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84694dec-31b2-4c4d-88d0-f704956f7b34 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.602420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d62fa-ff32-446c-a13f-f083b55b5581 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.617993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.635637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f0995-5087-40c6-8b68-6adfcaef5d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.636510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0995-5087-40c6-8b68-6adfcaef5d77 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.636789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0995-5087-40c6-8b68-6adfcaef5d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.637073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0995-5087-40c6-8b68-6adfcaef5d77 None admin] PATH_INFO: `/v3/groups/11c2deff6c7c4fc3a923ccf7380349c1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.638258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f0995-5087-40c6-8b68-6adfcaef5d77 None admin] RBAC: Authorizing `identity:get_group(group_id=11c2deff6c7c4fc3a923ccf7380349c1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.639870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f0995-5087-40c6-8b68-6adfcaef5d77 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.641492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 220/451] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/groups/11c2deff6c7c4fc3a923ccf7380349c1 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:38.647683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f0995-5087-40c6-8b68-6adfcaef5d77 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.666287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84694dec-31b2-4c4d-88d0-f704956f7b34 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.699845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90cb21-82e9-4519-9727-e073e991e2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.700725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90cb21-82e9-4519-9727-e073e991e2fd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.701015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90cb21-82e9-4519-9727-e073e991e2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.701290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90cb21-82e9-4519-9727-e073e991e2fd None admin] PATH_INFO: `/v3/projects/d21689e5ee72418fa4d0466bd95317f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.702480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90cb21-82e9-4519-9727-e073e991e2fd None admin] RBAC: Authorizing `identity:get_project(project_id=d21689e5ee72418fa4d0466bd95317f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.703933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90cb21-82e9-4519-9727-e073e991e2fd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.706211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 232/452] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/projects/d21689e5ee72418fa4d0466bd95317f4 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:38.711624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90cb21-82e9-4519-9727-e073e991e2fd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.735986 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.746724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f0995-5087-40c6-8b68-6adfcaef5d77 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.780995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.781731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.782005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.782276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.783090 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] RBAC: Adding query filter params (group.id=11c2deff6c7c4fc3a923ccf7380349c1, role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=ef6352e5d076419cbaba12161ca4f129) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:38.783394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.784835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.790467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 221/453] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/role_assignments?group.id=11c2deff6c7c4fc3a923ccf7380349c1&scope.project.id=ef6352e5d076419cbaba12161ca4f129&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:38.814589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90cb21-82e9-4519-9727-e073e991e2fd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.850411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe91143-f5e6-42af-b7a2-f209260cd957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.851278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe91143-f5e6-42af-b7a2-f209260cd957 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.851560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe91143-f5e6-42af-b7a2-f209260cd957 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.851836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe91143-f5e6-42af-b7a2-f209260cd957 None admin] PATH_INFO: `/v3/groups/a90a490dbe3044e1956607093649ffab` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.853158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe91143-f5e6-42af-b7a2-f209260cd957 None admin] RBAC: Authorizing `identity:get_group(group_id=a90a490dbe3044e1956607093649ffab)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.854610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe91143-f5e6-42af-b7a2-f209260cd957 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.856324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 233/454] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/groups/a90a490dbe3044e1956607093649ffab => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:38.863145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.914455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.967056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a95286-3d9f-45c6-bbd7-f10ad265f132 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:39.000430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ef10d-e13a-49ed-aeb4-fb542778cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:39.001690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef10d-e13a-49ed-aeb4-fb542778cb80 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.001970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef10d-e13a-49ed-aeb4-fb542778cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.002269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef10d-e13a-49ed-aeb4-fb542778cb80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.003093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef10d-e13a-49ed-aeb4-fb542778cb80 None admin] RBAC: Adding query filter params (group.id=a90a490dbe3044e1956607093649ffab, role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=d21689e5ee72418fa4d0466bd95317f4) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:39.003405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef10d-e13a-49ed-aeb4-fb542778cb80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:39.004857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef10d-e13a-49ed-aeb4-fb542778cb80 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:39.010854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 222/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/role_assignments?group.id=a90a490dbe3044e1956607093649ffab&scope.project.id=d21689e5ee72418fa4d0466bd95317f4&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:41.803573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933566f-6950-48fc-8f8f-b3d7a14c1150 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.804586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933566f-6950-48fc-8f8f-b3d7a14c1150 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.805056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933566f-6950-48fc-8f8f-b3d7a14c1150 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.806845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 234/456] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:41.812159 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262eadf-f9cd-4f09-8bca-7ec58394873f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.812545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262eadf-f9cd-4f09-8bca-7ec58394873f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.812718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262eadf-f9cd-4f09-8bca-7ec58394873f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.837057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f262eadf-f9cd-4f09-8bca-7ec58394873f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:41.838562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f262eadf-f9cd-4f09-8bca-7ec58394873f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:41.916380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f622a6-2456-498c-9e8e-695b36ebfeaf None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.916808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f622a6-2456-498c-9e8e-695b36ebfeaf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.917198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f622a6-2456-498c-9e8e-695b36ebfeaf None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.918785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 235/457] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:41.924313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5af38-5da7-453e-8186-e165076a7e5e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.924856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5af38-5da7-453e-8186-e165076a7e5e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.925331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5af38-5da7-453e-8186-e165076a7e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.945285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 223/458] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:41.960905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a4d5af38-5da7-453e-8186-e165076a7e5e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:41.962362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a4d5af38-5da7-453e-8186-e165076a7e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:41.968392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262eadf-f9cd-4f09-8bca-7ec58394873f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.030997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.081418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 236/459] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:42.083063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f231e-913c-4c6f-bf73-b5a8ca1d806c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.083569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f231e-913c-4c6f-bf73-b5a8ca1d806c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.084080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f231e-913c-4c6f-bf73-b5a8ca1d806c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.085711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 237/460] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:42.091616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3249a-bf04-4029-96b3-7017662f8a18 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.094024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3249a-bf04-4029-96b3-7017662f8a18 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.094024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3249a-bf04-4029-96b3-7017662f8a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.104361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262eadf-f9cd-4f09-8bca-7ec58394873f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.125512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a8b3249a-bf04-4029-96b3-7017662f8a18 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:42.127432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a8b3249a-bf04-4029-96b3-7017662f8a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:42.145085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.148068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.148862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.149142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.149417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.162079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.163523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:42.185274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:42.186165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:42.187000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:42.187000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:42.187000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:42.187000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:42.187000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 224/461] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:42.187759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.230622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 238/462] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:42.230622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3249a-bf04-4029-96b3-7017662f8a18 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.305456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.315864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7dfab8-edee-44e3-8e3b-03301d2516ea None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.359253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3249a-bf04-4029-96b3-7017662f8a18 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.366101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.367164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.367619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.368074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.384418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.386693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.400796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.401603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.401987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.402361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.403186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:42.403594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.405100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:42.411107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:42.412124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:42.413176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:42.413176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:42.413176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:42.413176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:42.414681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 225/463] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:42.416882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.427871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 239/464] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:42.428899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.440704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.530834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1d927-c90f-47c6-81c5-e4662c87b78a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.533007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab10257-4e4a-437e-905b-c9f3ff542d49 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.570336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303248ff-8c1f-46b1-b02a-3b998e001b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.570517 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.570918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303248ff-8c1f-46b1-b02a-3b998e001b1d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.571020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.571203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303248ff-8c1f-46b1-b02a-3b998e001b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.571299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.571484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303248ff-8c1f-46b1-b02a-3b998e001b1d None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.571578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.572290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303248ff-8c1f-46b1-b02a-3b998e001b1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:42.572559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303248ff-8c1f-46b1-b02a-3b998e001b1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.574404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303248ff-8c1f-46b1-b02a-3b998e001b1d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.581676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.583094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.586523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 240/465] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:42.588067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d373be8-d9be-4f5f-97e7-ca9bc0a5b55a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.588548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d373be8-d9be-4f5f-97e7-ca9bc0a5b55a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.588990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d373be8-d9be-4f5f-97e7-ca9bc0a5b55a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.589804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.591551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 241/466] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:42.592427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d373be8-d9be-4f5f-97e7-ca9bc0a5b55a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:42.607934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:42.608901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:42.609775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:42.609775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:42.609775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:42.609775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:42.612180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 226/467] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:42.613265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.664120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.704575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d373be8-d9be-4f5f-97e7-ca9bc0a5b55a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.725189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92433c1-2b22-477b-bdfe-d3d36cf6c665 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.743620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bcf46-ce1a-4ceb-8e14-e13e66c6c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.744323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bcf46-ce1a-4ceb-8e14-e13e66c6c00b None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.744608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bcf46-ce1a-4ceb-8e14-e13e66c6c00b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.744886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bcf46-ce1a-4ceb-8e14-e13e66c6c00b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.745595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bcf46-ce1a-4ceb-8e14-e13e66c6c00b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.747031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bcf46-ce1a-4ceb-8e14-e13e66c6c00b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.765358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81507a-5683-4010-ac2a-0327fe369600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.767848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81507a-5683-4010-ac2a-0327fe369600 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.767848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81507a-5683-4010-ac2a-0327fe369600 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.767848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81507a-5683-4010-ac2a-0327fe369600 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.767848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81507a-5683-4010-ac2a-0327fe369600 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.768745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81507a-5683-4010-ac2a-0327fe369600 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.850374 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 242/468] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:42 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:42.851845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70229e6e-d782-4fd4-8857-87c503b3b848 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.852141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70229e6e-d782-4fd4-8857-87c503b3b848 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.852425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70229e6e-d782-4fd4-8857-87c503b3b848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.871368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-70229e6e-d782-4fd4-8857-87c503b3b848 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:42.873698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-70229e6e-d782-4fd4-8857-87c503b3b848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:42.884444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 227/469] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:42 2022] POST /identity/v3/users => generated 246 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:42.886200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81507a-5683-4010-ac2a-0327fe369600 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.960462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:43.010798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81507a-5683-4010-ac2a-0327fe369600 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.046454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 243/470] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:43.052408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.053502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.054143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.054625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.055695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:43.056281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.058049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.073208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70229e6e-d782-4fd4-8857-87c503b3b848 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.074161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 228/471] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:43.080598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.152468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:43.210890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94bc59-e3de-4091-8254-aec3e6f51612 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.211479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70229e6e-d782-4fd4-8857-87c503b3b848 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.230776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:43.252539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c1650-b0dd-4d2e-b001-6451614f98b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.253122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1650-b0dd-4d2e-b001-6451614f98b9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.253403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1650-b0dd-4d2e-b001-6451614f98b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.253679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c1650-b0dd-4d2e-b001-6451614f98b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.255674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8145c6-6d23-49a3-8159-9374b229778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.255674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8145c6-6d23-49a3-8159-9374b229778e None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.256033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8145c6-6d23-49a3-8159-9374b229778e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.256331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8145c6-6d23-49a3-8159-9374b229778e None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.256942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8145c6-6d23-49a3-8159-9374b229778e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.258377 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8145c6-6d23-49a3-8159-9374b229778e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.265862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c1650-b0dd-4d2e-b001-6451614f98b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.267858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c1650-b0dd-4d2e-b001-6451614f98b9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-012c1650-b0dd-4d2e-b001-6451614f98b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:43.289940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:43.290847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:43.292379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:43.292379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:43.292379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:43.292379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:43.292379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 244/472] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:43.292772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614189bf-b93f-44d6-a18f-7ca12f100741 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.294774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614189bf-b93f-44d6-a18f-7ca12f100741 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.294774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614189bf-b93f-44d6-a18f-7ca12f100741 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.294774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 245/473] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:43.296565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614189bf-b93f-44d6-a18f-7ca12f100741 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.370076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 229/474] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:43 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:22:43.372634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee1ff1-ed9e-4fc5-a0c1-e8f425ced097 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.373033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee1ff1-ed9e-4fc5-a0c1-e8f425ced097 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.373354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee1ff1-ed9e-4fc5-a0c1-e8f425ced097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.394239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b7ee1ff1-ed9e-4fc5-a0c1-e8f425ced097 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:43.395438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b7ee1ff1-ed9e-4fc5-a0c1-e8f425ced097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:43.449899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614189bf-b93f-44d6-a18f-7ca12f100741 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.468610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:43.514821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.515533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.515818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.516117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.517378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:43.517685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.519144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.533250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 246/475] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:43.538343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.544136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 230/476] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:43.591276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee1ff1-ed9e-4fc5-a0c1-e8f425ced097 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.664418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091eee-9428-40b2-b133-61ca1db2cfea None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.708544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fee1a-2205-47ce-a08c-47297c54e2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.709194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fee1a-2205-47ce-a08c-47297c54e2aa None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.709474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fee1a-2205-47ce-a08c-47297c54e2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.710207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fee1a-2205-47ce-a08c-47297c54e2aa None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.710918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fee1a-2205-47ce-a08c-47297c54e2aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.712685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fee1a-2205-47ce-a08c-47297c54e2aa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.719981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:43.725156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee1ff1-ed9e-4fc5-a0c1-e8f425ced097 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.767429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.768142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.768419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.768687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.769425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.770783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.810047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 00:22:43.810047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 00:22:43.810047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [parameters: {'id': '104bf373b33f4f90968e436988ebea6b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 00:22:43.810047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jun 15 00:22:43.828236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return ref.to_dict() Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:22:43.829740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 00:22:43.831318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 00:22:43.832881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:22:43.834396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:22:43.837503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'id': '104bf373b33f4f90968e436988ebea6b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:43.839255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 00:22:43.840741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:43.842342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 231/477] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jun 15 00:22:43 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:43.842342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.855282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 247/478] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:43 2022] POST /identity/v3/users => generated 249 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:43.995959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caf383-af46-4e23-af7a-b99aa452a97a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:44.046084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4fed-6ae5-481b-960f-2342b057edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:44.046906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4fed-6ae5-481b-960f-2342b057edba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.047188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4fed-6ae5-481b-960f-2342b057edba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.047459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4fed-6ae5-481b-960f-2342b057edba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.058720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de4fed-6ae5-481b-960f-2342b057edba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f6de4fed-6ae5-481b-960f-2342b057edba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:44.067014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:44.069491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:44.071468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 232/479] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:44.081070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fee1a-2205-47ce-a08c-47297c54e2aa None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:44.142485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:44.233860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fee1a-2205-47ce-a08c-47297c54e2aa None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:44.269788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8ef4c-1e11-4699-9c28-808575ee3a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:44.270807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ef4c-1e11-4699-9c28-808575ee3a3f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.271289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ef4c-1e11-4699-9c28-808575ee3a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.271792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ef4c-1e11-4699-9c28-808575ee3a3f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.272772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8ef4c-1e11-4699-9c28-808575ee3a3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:44.273276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8ef4c-1e11-4699-9c28-808575ee3a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:44.274860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8ef4c-1e11-4699-9c28-808575ee3a3f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:44.284340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 248/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:45.423478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286fc3a-4481-4ff8-b4b5-41f2d8b7df83 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.424139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286fc3a-4481-4ff8-b4b5-41f2d8b7df83 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.424139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286fc3a-4481-4ff8-b4b5-41f2d8b7df83 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.425684 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 233/481] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:45.431482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0e51-ea8f-477a-a638-0853ff805b9d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.431891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0e51-ea8f-477a-a638-0853ff805b9d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.432063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0e51-ea8f-477a-a638-0853ff805b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.456976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0e2f0e51-ea8f-477a-a638-0853ff805b9d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:45.458178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0e2f0e51-ea8f-477a-a638-0853ff805b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:45.569233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 249/482] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:45.605387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286fc3a-4481-4ff8-b4b5-41f2d8b7df83 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:45.640822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.749527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286fc3a-4481-4ff8-b4b5-41f2d8b7df83 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:45.793459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bed88-5393-4860-a5c6-4bb30764dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:45.794249 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bed88-5393-4860-a5c6-4bb30764dfbe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.794530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bed88-5393-4860-a5c6-4bb30764dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.794801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bed88-5393-4860-a5c6-4bb30764dfbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.807724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bed88-5393-4860-a5c6-4bb30764dfbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5e7bed88-5393-4860-a5c6-4bb30764dfbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:45.820242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:45.821331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:45.822321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 234/483] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:45.825707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815b3e-ee30-4ce5-a2f7-f6c7b3d4c02f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.825924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815b3e-ee30-4ce5-a2f7-f6c7b3d4c02f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.826283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa815b3e-ee30-4ce5-a2f7-f6c7b3d4c02f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.827628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 250/484] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:45.828486 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bed88-5393-4860-a5c6-4bb30764dfbe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:45.836727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1adddc-c9c6-4798-ac33-e2555b7af225 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.837089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1adddc-c9c6-4798-ac33-e2555b7af225 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.837441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1adddc-c9c6-4798-ac33-e2555b7af225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.874211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0f1adddc-c9c6-4798-ac33-e2555b7af225 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:45.875400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0f1adddc-c9c6-4798-ac33-e2555b7af225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:45.892253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.962383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.991137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bed88-5393-4860-a5c6-4bb30764dfbe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.001452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 251/485] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:46.025647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1adddc-c9c6-4798-ac33-e2555b7af225 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.054613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d9772-b7d0-4b4e-a759-db25ba889be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.055759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9772-b7d0-4b4e-a759-db25ba889be3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.056280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9772-b7d0-4b4e-a759-db25ba889be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.056698 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d9772-b7d0-4b4e-a759-db25ba889be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.057582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d9772-b7d0-4b4e-a759-db25ba889be3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.058025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d9772-b7d0-4b4e-a759-db25ba889be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.059536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d9772-b7d0-4b4e-a759-db25ba889be3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.074724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 235/486] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:46.074724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cfdd-ca45-4f03-b3c5-458cd0d97eb0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.074724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cfdd-ca45-4f03-b3c5-458cd0d97eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.074724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cfdd-ca45-4f03-b3c5-458cd0d97eb0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.074724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 236/487] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:46.076768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019cfdd-ca45-4f03-b3c5-458cd0d97eb0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.138017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1adddc-c9c6-4798-ac33-e2555b7af225 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.171896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54914ef7-9191-4e5f-9e2e-8e05cc8262cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.173421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914ef7-9191-4e5f-9e2e-8e05cc8262cd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.173704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914ef7-9191-4e5f-9e2e-8e05cc8262cd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.173974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54914ef7-9191-4e5f-9e2e-8e05cc8262cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.184173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54914ef7-9191-4e5f-9e2e-8e05cc8262cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-54914ef7-9191-4e5f-9e2e-8e05cc8262cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:46.191939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:46.192810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:46.193599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 252/488] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:46.194807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e695e51-5a04-4509-8413-536bdb3ab12f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.194926 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e695e51-5a04-4509-8413-536bdb3ab12f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.195226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e695e51-5a04-4509-8413-536bdb3ab12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.203422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019cfdd-ca45-4f03-b3c5-458cd0d97eb0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.208808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.223304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6e695e51-5a04-4509-8413-536bdb3ab12f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:46.225182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6e695e51-5a04-4509-8413-536bdb3ab12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:46.241958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.242770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.243185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.243461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.255968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.257468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.264615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:46.277132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:46.279675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:46.280565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:46.280565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:46.280565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:46.280565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:46.283647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 237/489] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:46.284623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.308061 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 253/490] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:46.309347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e695e51-5a04-4509-8413-536bdb3ab12f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.392935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223133ce-5f6d-4142-b6c3-c37a8e6404cc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.429605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.430355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.430556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.430880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.431782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.432120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.433568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.436039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e695e51-5a04-4509-8413-536bdb3ab12f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.447177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 238/491] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:46.447177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.477685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.478595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.479079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.479519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.480546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.481138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.482696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.484650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.496269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 254/492] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:46.497411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.513100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.557573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747f9a9-b6f4-484b-b030-555ac146f88d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.594340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87823-dd18-486a-8aac-a5ee8fbdf262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.595803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87823-dd18-486a-8aac-a5ee8fbdf262 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.596197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87823-dd18-486a-8aac-a5ee8fbdf262 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.596503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87823-dd18-486a-8aac-a5ee8fbdf262 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.606569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca497d5e-5867-4674-8399-3c342bcee946 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.609195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c87823-dd18-486a-8aac-a5ee8fbdf262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-01c87823-dd18-486a-8aac-a5ee8fbdf262 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:46.617989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:46.618947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:46.619718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:46.624410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 239/493] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:46.625440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87823-dd18-486a-8aac-a5ee8fbdf262 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.652204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.653373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.653847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.654310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.666066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.667790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:46.686599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:46.687573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:46.689060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:46.689060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:46.689060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:46.689060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:46.689976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 255/494] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:46.689976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.737280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87823-dd18-486a-8aac-a5ee8fbdf262 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.752333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.761621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.776000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766708c-2411-4e71-9152-b014d4651e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.776856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766708c-2411-4e71-9152-b014d4651e02 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.777146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766708c-2411-4e71-9152-b014d4651e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.777436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766708c-2411-4e71-9152-b014d4651e02 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.784964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766708c-2411-4e71-9152-b014d4651e02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.786402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766708c-2411-4e71-9152-b014d4651e02 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a766708c-2411-4e71-9152-b014d4651e02 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:46.801875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:46.802805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:46.803692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 240/495] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:46.804935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5d8e-de90-4351-9c40-0f6cd9b04ec7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.804935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5d8e-de90-4351-9c40-0f6cd9b04ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.804935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5d8e-de90-4351-9c40-0f6cd9b04ec7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.806300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 241/496] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:46.809147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5d8e-de90-4351-9c40-0f6cd9b04ec7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.815217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1de3f-85c6-4bde-a6d7-174eaded832c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.852745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.853423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.853702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.853973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.854727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.855030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.856575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.866199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 256/497] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:46.866999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.925667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5d8e-de90-4351-9c40-0f6cd9b04ec7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.958397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d6c38-035c-4c12-adf6-7ba1b0c8fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.959053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d6c38-035c-4c12-adf6-7ba1b0c8fc90 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.959325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d6c38-035c-4c12-adf6-7ba1b0c8fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.959592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d6c38-035c-4c12-adf6-7ba1b0c8fc90 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.960337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d6c38-035c-4c12-adf6-7ba1b0c8fc90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.960639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d6c38-035c-4c12-adf6-7ba1b0c8fc90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.961987 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d6c38-035c-4c12-adf6-7ba1b0c8fc90 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.968848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4c21c-0bfd-4136-afa5-7146a9a9e555 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.973538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 242/498] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:46.974727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5c27-b1f2-42c7-bbc4-dc9c1f9d9695 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.975015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5c27-b1f2-42c7-bbc4-dc9c1f9d9695 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.975293 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5c27-b1f2-42c7-bbc4-dc9c1f9d9695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.978256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.992275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8b9a5c27-b1f2-42c7-bbc4-dc9c1f9d9695 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:46.993459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8b9a5c27-b1f2-42c7-bbc4-dc9c1f9d9695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:47.002690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.003593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.003950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.004364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.005248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:47.005872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.007309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.027167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.042450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 257/499] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:47.043349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.060569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 243/500] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:47.062250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad240381-c44e-4257-9ce8-c963238a5a65 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.062749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad240381-c44e-4257-9ce8-c963238a5a65 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.063173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad240381-c44e-4257-9ce8-c963238a5a65 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.068375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 244/501] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:47.068375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad240381-c44e-4257-9ce8-c963238a5a65 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.147979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445895c-7db4-4a44-82df-35c511c81c5f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.164741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad240381-c44e-4257-9ce8-c963238a5a65 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.181058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.181847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.182125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.182399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.192648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.194096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.198221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e9471-734c-49b2-a546-d315d86abd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.198997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9471-734c-49b2-a546-d315d86abd34 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.199278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9471-734c-49b2-a546-d315d86abd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.199557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9471-734c-49b2-a546-d315d86abd34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.206655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e9471-734c-49b2-a546-d315d86abd34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.208112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e9471-734c-49b2-a546-d315d86abd34 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:47.210891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:47.211847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:47.217615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:47.217615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:47.217615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:47.217615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:47.217615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 258/502] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:47.217615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bc6e9471-734c-49b2-a546-d315d86abd34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:47.222287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:47.223294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:47.224319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 245/503] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:47.224878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1f3f-7ce0-4498-8e15-fbaffdabc6ed None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.224951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1f3f-7ce0-4498-8e15-fbaffdabc6ed None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.225220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c1f3f-7ce0-4498-8e15-fbaffdabc6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.238870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.241331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-450c1f3f-7ce0-4498-8e15-fbaffdabc6ed None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:47.242508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-450c1f3f-7ce0-4498-8e15-fbaffdabc6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:47.266078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.307372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 246/504] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:47.324067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c1f3f-7ce0-4498-8e15-fbaffdabc6ed None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.324168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41ac1e-f7bb-4ca6-a484-be3a4df8a73c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.352831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3fef-5fe6-492f-be72-d4a20f91cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.353468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3fef-5fe6-492f-be72-d4a20f91cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.353753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3fef-5fe6-492f-be72-d4a20f91cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.354025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb3fef-5fe6-492f-be72-d4a20f91cdf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.406388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c1f3f-7ce0-4498-8e15-fbaffdabc6ed None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.418908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb3fef-5fe6-492f-be72-d4a20f91cdf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.420447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb3fef-5fe6-492f-be72-d4a20f91cdf4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.438231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.440187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f36446-e82d-4537-afa9-d441b3d92c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.441210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f36446-e82d-4537-afa9-d441b3d92c50 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.441340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f36446-e82d-4537-afa9-d441b3d92c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.441507 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f36446-e82d-4537-afa9-d441b3d92c50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.451626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f36446-e82d-4537-afa9-d441b3d92c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-54f36446-e82d-4537-afa9-d441b3d92c50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:47.459216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:47.460094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:47.460897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 247/505] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:47.461533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f36446-e82d-4537-afa9-d441b3d92c50 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.486665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.520651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 259/506] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:47.521470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3fef-5fe6-492f-be72-d4a20f91cdf4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.567887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f36446-e82d-4537-afa9-d441b3d92c50 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.600815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.601462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.601741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.602012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.602718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:47.603017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.604431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.616212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 248/507] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:47.616969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.628212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb3fef-5fe6-492f-be72-d4a20f91cdf4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.645180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.661496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.663427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.663427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.663427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.663658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:47.663825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.665279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.682581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 260/508] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:47.683380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.696047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.714735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49172f3-e3e9-419f-be58-02df553f1221 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.752221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.753012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.753288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.753559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.763631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.765090 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.782938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f514-6584-4180-bc20-5a2b16613d28 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:47.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:47.784049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:47.790004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:47.790004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:47.790004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:47.790004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:47.790004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 249/509] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:47.790004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.817024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.817679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.818017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.818239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.818977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:47.819282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.820669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.828535 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 261/510] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:47.830110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.868810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.891202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f819f-c684-425e-995e-d3f09a5c0fd6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.920312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.925008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.925821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.926135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.926344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.926956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14b233-a728-4f61-98d7-af55f844d7a9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.935991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.937420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:47.955063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:47.956096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:47.956990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:47.956990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:47.956990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:47.956990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:47.958854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 250/511] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:47.959713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.961136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.961925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.962463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.962739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.970919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.972383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:47.987273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:47.988185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:47.989068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 262/512] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:47.989614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.061625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f0ad9-9d82-46d9-927b-ea977772f784 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.086815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.090220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd57fb9-8f24-4060-a0bd-073940504fb6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.095202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c7e7-6a65-4e9a-9715-f237526c5167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.095840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c7e7-6a65-4e9a-9715-f237526c5167 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.096149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c7e7-6a65-4e9a-9715-f237526c5167 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.096420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c7e7-6a65-4e9a-9715-f237526c5167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.122809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.123843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.124339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.124709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.125560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:48.126983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.128430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.140015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 263/513] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:48.140801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.148042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.162948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10c7e7-6a65-4e9a-9715-f237526c5167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.164415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10c7e7-6a65-4e9a-9715-f237526c5167 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.238793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c57c7-1826-4d95-8f53-4bd7e069d9bf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.261411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 251/514] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:48.262227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c7e7-6a65-4e9a-9715-f237526c5167 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.272134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.272908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.273187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.273460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.283165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.284610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:48.302103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:48.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:48.304132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:48.304132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:48.304132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:48.304132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:48.304132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 264/515] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:48.304557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.316224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.347652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.363329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c7e7-6a65-4e9a-9715-f237526c5167 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.398320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.398969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.399242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.399511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.400250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:48.400552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.401908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.402480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf529f3-5c2a-433d-a06f-8b178782f8cf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.412795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 252/516] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:48.413565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.440669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.441334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.441620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.441896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.442740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:48.443052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.444529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.462475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 265/517] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:48.463262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.510351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862915-7f95-48e2-b6bf-e16cc3adc940 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.526969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.542947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05422787-267d-46a4-9994-7843c915913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.543619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05422787-267d-46a4-9994-7843c915913f None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.543929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05422787-267d-46a4-9994-7843c915913f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.544209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05422787-267d-46a4-9994-7843c915913f None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.544907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05422787-267d-46a4-9994-7843c915913f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.546358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05422787-267d-46a4-9994-7843c915913f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.559150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d280-26e5-4883-b787-1aa8d88010d6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.592012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.592802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.593095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.593366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.603026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.604457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:48.622238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:48.623224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:48.624357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:48.624357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:48.624357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:48.624357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:48.624357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 266/518] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:48.624357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.632220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.651937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 253/519] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:48 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:48.651937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05422787-267d-46a4-9994-7843c915913f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.743533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293870be-8e94-4dac-84ab-b3693f390ab5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.755169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05422787-267d-46a4-9994-7843c915913f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.766849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.781470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.782177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.782458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.782767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.783497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:48.783871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.785300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.795369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.796172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.796461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.796734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.799060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 267/520] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:48.800752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.805832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.807279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:48.824856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:48.825733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:48.826575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:48.826575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:48.826575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:48.826575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:48.826575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:48.826575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:48.826575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:48.826575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:48.828554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 254/521] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:48.829563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.896919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.911065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d692e5-5d34-49dd-97a9-f271f615c86b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.940654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba00d8a-a44c-407d-8b4b-b35c763079d8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.946059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe219ff6-8fbc-43fc-906d-ad4f71124e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.946708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219ff6-8fbc-43fc-906d-ad4f71124e93 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.947009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219ff6-8fbc-43fc-906d-ad4f71124e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.947267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219ff6-8fbc-43fc-906d-ad4f71124e93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.976512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.977174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.977457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.977728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.978445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:48.978750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.980136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.993279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 255/522] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:48.993926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.002680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.025125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe219ff6-8fbc-43fc-906d-ad4f71124e93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.026565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe219ff6-8fbc-43fc-906d-ad4f71124e93 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.099636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd700-7d2b-4629-a31b-983d4a0372a1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.120624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.132866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 268/523] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:49.133848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe219ff6-8fbc-43fc-906d-ad4f71124e93 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.140072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.140877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.141225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.142048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.150042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.152127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:49.166426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:49.167444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 256/524] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:49.168868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.225701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.244393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe219ff6-8fbc-43fc-906d-ad4f71124e93 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.275090 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf5fc2-8f83-4646-86f0-d8fbc56bbebf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.279848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.280671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.281124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.281545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.282491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:49.282942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.284550 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.304673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 269/525] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:49.306001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.312827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.314171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.314452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.314725 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.321681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.323126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:49.337766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:49.338712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:49.339534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 257/526] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:49.340496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.385943 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.422470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad0bca-0557-41c7-92f2-cf7437bf66df None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.446453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eefc7-9fb3-4e0c-b91d-73b2a01486b8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.458573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.459385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.459666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.459955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.469103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.472111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.473670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.481747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.482544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.482824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.483098 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.483956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:49.484262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.485746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:49.492597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:49.493487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:49.494347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:49.494347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:49.494347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:49.494347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:49.495050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 270/527] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:49.498941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.532852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 258/528] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:49.532852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.609869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf39997-4273-4b63-adf3-bda5f0035ff8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.638006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.642820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59242020-7680-4ba6-bbae-207e45064c24 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.646263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.646913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.647194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.647469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.648327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=17d6317775c343eaa9397254074647f5) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:49.648639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.650065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.655466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 271/529] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/role_assignments?user.id=17d6317775c343eaa9397254074647f5&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:49.656250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.698416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.699384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.699884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.700377 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.701369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:49.701861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.703522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.729570 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 259/530] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:49.730839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.743777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.809579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07039099-a20b-4dd9-b30d-bba109480a8d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.855295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.856403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.856764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.857268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.858387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:49.858974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.860449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.860636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab13857-c861-4dac-80f9-93a119bec5a4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.874695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 272/531] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:49.875536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.897536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec459794-989a-4cb5-9645-e774a14358e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.898189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec459794-989a-4cb5-9645-e774a14358e0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.898475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec459794-989a-4cb5-9645-e774a14358e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.898751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec459794-989a-4cb5-9645-e774a14358e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.927644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.972407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec459794-989a-4cb5-9645-e774a14358e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.973899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec459794-989a-4cb5-9645-e774a14358e0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.007064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518bcd0-e833-4f61-b21d-d0b460736725 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.026805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.045240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.046045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.046433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.046829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.048432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=ad41d031778c4e8ebc8c176c3670f4b2) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:50.048924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.050552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.056835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 273/532] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/role_assignments?user.id=ad41d031778c4e8ebc8c176c3670f4b2&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:50.057772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.115792 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 260/533] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:50.122146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec459794-989a-4cb5-9645-e774a14358e0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.171357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d4cee-3c1f-4dfb-8351-aca554049f0a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.200631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.210305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.211353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.211748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.212149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.219458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.221229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:50.238147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:50.239169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:50.240364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:50.240364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:50.240364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:50.240364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:50.240364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:50.240364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:50.240364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:50.240364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:50.243947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 274/534] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:50.247601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.253142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec459794-989a-4cb5-9645-e774a14358e0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.292923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.299192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.300202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.300593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.300931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.313096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.315308 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:50.347591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:50.348648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:50.349735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:50.349735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:50.349735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:50.349735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:50.355934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 261/535] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:50.362116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.380790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0f5a1-1500-4c1e-b340-9b0f0a48de92 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.477849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.479725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.480911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.481294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.482829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:50.483406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.487299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.491762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635d3e-94ed-4a6c-a8f5-52dbb900c63f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.512306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.512552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 275/536] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:50.519644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.564884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.565563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.565831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.566106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.566834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:50.567144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.568563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.595937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 262/537] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:50.602908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.687900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.692538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9ba1c-8df7-4b01-830c-2c7af2d827f0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.741178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.741909 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.742189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.742470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.743371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=4033fb5bc0624281a97a979a75ce13e9) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:50.743685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.745162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.754806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 276/538] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/role_assignments?user.id=4033fb5bc0624281a97a979a75ce13e9&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:50.795385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab183d-7d9a-4ba9-9378-7d3068516c35 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.836405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482b26-da93-4851-8310-5efe86f22275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.837207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482b26-da93-4851-8310-5efe86f22275 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.837489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482b26-da93-4851-8310-5efe86f22275 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.837765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482b26-da93-4851-8310-5efe86f22275 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.845226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482b26-da93-4851-8310-5efe86f22275 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.846705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb482b26-da93-4851-8310-5efe86f22275 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bb482b26-da93-4851-8310-5efe86f22275 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:50.861793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:50.863774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:50.865808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 263/539] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:50.871944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.895025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dda15-448c-4dd7-8ecc-2e2dee44c40e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.895329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dda15-448c-4dd7-8ecc-2e2dee44c40e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.895583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dda15-448c-4dd7-8ecc-2e2dee44c40e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.897472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 264/540] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:50.903133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee796-930b-4a7e-82ed-61199833350e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.903407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee796-930b-4a7e-82ed-61199833350e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.903721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee796-930b-4a7e-82ed-61199833350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.939899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-200ee796-930b-4a7e-82ed-61199833350e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:50.941166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-200ee796-930b-4a7e-82ed-61199833350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:50.976683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.017619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 265/541] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:51.041244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ee796-930b-4a7e-82ed-61199833350e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.058310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1444a9-8acb-4eb9-9909-87cadf4a5370 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.105496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.106266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.106552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.106825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.107717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:51.108164 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.109595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.142657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 277/542] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:51.149762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.159350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ee796-930b-4a7e-82ed-61199833350e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.191080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.196526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c2edd-e889-4c8d-953e-59e48a397106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.197327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c2edd-e889-4c8d-953e-59e48a397106 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.197611 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c2edd-e889-4c8d-953e-59e48a397106 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.197889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c2edd-e889-4c8d-953e-59e48a397106 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.208641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c2edd-e889-4c8d-953e-59e48a397106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-871c2edd-e889-4c8d-953e-59e48a397106 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:51.216545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:51.217441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:51.218672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 266/543] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:51.224233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c2edd-e889-4c8d-953e-59e48a397106 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.252520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.329912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509326-b044-4b53-acaf-892fbdab358d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.369954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.370619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.370906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.371191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.372060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=1eaffae68edd4031ac771310b7d645cc) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:51.372379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.373819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.378018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c2edd-e889-4c8d-953e-59e48a397106 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.380322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 278/544] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/role_assignments?user.id=1eaffae68edd4031ac771310b7d645cc&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:51.444855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.445558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.445842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.446119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.446886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:51.447195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.448654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.459100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 267/545] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:51.464635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.582787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.601331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f4250-f2ef-40e8-a2fd-36225ec0c948 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.649059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.650158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.650586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.651007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.663046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.664969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:51.685953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:51.686965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:51.688158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:51.688158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:51.688158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:51.688158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:51.689832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 279/546] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:51.695498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.819800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.842496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7035540-0dfd-48f9-9949-e0d4f27f0d14 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.894258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.894924 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.895204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.895480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.896235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:51.896542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.897903 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.919352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 268/547] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:51.925099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:52.072530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731d535-3ce9-4a6d-97d1-10854fa9c64d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:52.116804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddf443-6c60-44e3-9ac2-5312100cf96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:52.117515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddf443-6c60-44e3-9ac2-5312100cf96d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.117793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddf443-6c60-44e3-9ac2-5312100cf96d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.118065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddf443-6c60-44e3-9ac2-5312100cf96d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.129031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddf443-6c60-44e3-9ac2-5312100cf96d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:52.130482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddf443-6c60-44e3-9ac2-5312100cf96d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:52.133414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-daddf443-6c60-44e3-9ac2-5312100cf96d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:52.150812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:52.151991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:52.152896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 280/548] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:52.160608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:52.303816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e10c0-ec2d-4595-aec5-bd6ace6dfde6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:52.350707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:52.351783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.352321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.352829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.353887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:52.354433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:52.356100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:52.367846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32040-c43b-4417-aba1-aa57773ace8c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.372171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32040-c43b-4417-aba1-aa57773ace8c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.372171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd32040-c43b-4417-aba1-aa57773ace8c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.372171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 281/549] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:52.374698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793690c-da13-408e-8637-04c94a8e3f3a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.374977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793690c-da13-408e-8637-04c94a8e3f3a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.375307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793690c-da13-408e-8637-04c94a8e3f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.376836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:52.380959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 269/550] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jun 15 00:22:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:52.389694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:52.417626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e793690c-da13-408e-8637-04c94a8e3f3a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:52.419272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e793690c-da13-408e-8637-04c94a8e3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:52.491461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5b834-564d-409a-be3e-e26e07b66f57 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:52.528094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000916d-f296-4043-be22-ef346ff663db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:52.528822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000916d-f296-4043-be22-ef346ff663db None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.529107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000916d-f296-4043-be22-ef346ff663db None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.529434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000916d-f296-4043-be22-ef346ff663db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.544722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 282/551] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:52.568424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793690c-da13-408e-8637-04c94a8e3f3a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:52.609156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:52.612431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000916d-f296-4043-be22-ef346ff663db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:52.614480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000916d-f296-4043-be22-ef346ff663db None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:52.722045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793690c-da13-408e-8637-04c94a8e3f3a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:52.738271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 270/552] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:22:52.744744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000916d-f296-4043-be22-ef346ff663db None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:52.785318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:52.788512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d02a3-d711-4baa-af97-62bbdb2293fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:52.789309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d02a3-d711-4baa-af97-62bbdb2293fd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.789590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d02a3-d711-4baa-af97-62bbdb2293fd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.789867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d02a3-d711-4baa-af97-62bbdb2293fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.800879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d02a3-d711-4baa-af97-62bbdb2293fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-303d02a3-d711-4baa-af97-62bbdb2293fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:52.809358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:52.810428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:52.811455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 283/553] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:52.812342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5d15a-3a87-4e1e-8961-370d85f4c23e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.812342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5d15a-3a87-4e1e-8961-370d85f4c23e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.812610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5d15a-3a87-4e1e-8961-370d85f4c23e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.818800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 284/554] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:52.819811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5d15a-3a87-4e1e-8961-370d85f4c23e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:52.852150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:52.855301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000916d-f296-4043-be22-ef346ff663db None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:52.890734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f2269-656a-4865-8141-cd91c03f8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:52.892360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2269-656a-4865-8141-cd91c03f8338 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.892815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2269-656a-4865-8141-cd91c03f8338 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.893238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2269-656a-4865-8141-cd91c03f8338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.904414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f2269-656a-4865-8141-cd91c03f8338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:52.906254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f2269-656a-4865-8141-cd91c03f8338 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-935f2269-656a-4865-8141-cd91c03f8338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:52.925866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:52.926859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:52.927743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:52.927743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:52.927743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:52.927743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:52.929537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5d15a-3a87-4e1e-8961-370d85f4c23e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:52.934313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 271/555] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:52.935857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321160e-1d68-41fb-9f02-7839b5e74e0e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.936444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321160e-1d68-41fb-9f02-7839b5e74e0e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.936902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321160e-1d68-41fb-9f02-7839b5e74e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.956520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7321160e-1d68-41fb-9f02-7839b5e74e0e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:52.958077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7321160e-1d68-41fb-9f02-7839b5e74e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:52.967968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:52.968698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.968978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.969282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.970086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:52.970391 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:52.971886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:52.980931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 285/556] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:52.981752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.036020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 272/557] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:53.037251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321160e-1d68-41fb-9f02-7839b5e74e0e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.046573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.113604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe97ef7-0aed-4d30-aa85-595335cc75fc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.135481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.148151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.148813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.149094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.149422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.150084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:53.150387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.151753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.157746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321160e-1d68-41fb-9f02-7839b5e74e0e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.168286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 286/558] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:53.168286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.204013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.205130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.205668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.206185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.220044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.223112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:53.243275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:53.244681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:53.245560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:53.245560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:53.245560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:53.245560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:53.247953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 273/559] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:53.248951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.266420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7aecc-2a1e-44f8-8081-c703352b1e65 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.279599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.300619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0189f4-dded-4fa9-9c97-a756f7742ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.301413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0189f4-dded-4fa9-9c97-a756f7742ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.301707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0189f4-dded-4fa9-9c97-a756f7742ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.301984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0189f4-dded-4fa9-9c97-a756f7742ca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.312268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0189f4-dded-4fa9-9c97-a756f7742ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-6a0189f4-dded-4fa9-9c97-a756f7742ca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:53.320789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:53.321906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:53.322999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:53.330288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 287/560] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:53.331237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0189f4-dded-4fa9-9c97-a756f7742ca0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.371740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c0302-2878-46d4-87c1-3e25fddc79e1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.415873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.417039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.417490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.417913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.420332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.427982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.429798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.443161 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0189f4-dded-4fa9-9c97-a756f7742ca0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:53.445775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:53.446933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:53.447800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:53.447800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:53.447800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:53.447800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:53.447800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:53.447800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:53.447800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:53.447800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:53.452060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 274/561] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:53.453617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.482130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b711694-3ba3-496d-9bac-7b59e586957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.482942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b711694-3ba3-496d-9bac-7b59e586957c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.483526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b711694-3ba3-496d-9bac-7b59e586957c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.483812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b711694-3ba3-496d-9bac-7b59e586957c None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.485487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b711694-3ba3-496d-9bac-7b59e586957c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:53.486051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b711694-3ba3-496d-9bac-7b59e586957c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.488038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b711694-3ba3-496d-9bac-7b59e586957c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.508087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 288/562] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:53.508087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988226c-cbde-4dd7-9d16-e17dfb941e5b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.508087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988226c-cbde-4dd7-9d16-e17dfb941e5b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.508087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988226c-cbde-4dd7-9d16-e17dfb941e5b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.508087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 289/563] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:53.508527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988226c-cbde-4dd7-9d16-e17dfb941e5b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.545636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.560871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87519666-d0a8-4fe7-aa64-0d5cbd1a56ac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.597427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.598259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.598643 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.599023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.599854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:53.600183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.601664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.610588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 275/564] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:53.611416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.628035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988226c-cbde-4dd7-9d16-e17dfb941e5b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.666703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc0b82-0116-442e-bfe9-5d6d51c5a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.667352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc0b82-0116-442e-bfe9-5d6d51c5a327 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.667632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc0b82-0116-442e-bfe9-5d6d51c5a327 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.667930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc0b82-0116-442e-bfe9-5d6d51c5a327 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.668699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc0b82-0116-442e-bfe9-5d6d51c5a327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:53.669008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc0b82-0116-442e-bfe9-5d6d51c5a327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.670174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.670419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc0b82-0116-442e-bfe9-5d6d51c5a327 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.682411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 290/565] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:53.683445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449bcf-5d4d-439f-9671-39f19f6a3917 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.683731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449bcf-5d4d-439f-9671-39f19f6a3917 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.684034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449bcf-5d4d-439f-9671-39f19f6a3917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.700360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-aa449bcf-5d4d-439f-9671-39f19f6a3917 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:53.701516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aa449bcf-5d4d-439f-9671-39f19f6a3917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:53.722490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a17f1-8bc9-48ee-82f4-a8f384a93e6e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.762442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.763255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.763544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.763824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.771914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.773371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.776756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 291/566] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:53.780877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449bcf-5d4d-439f-9671-39f19f6a3917 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:53.787634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:53.788612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:53.789540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 276/567] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:53.790125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.819858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.896444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29517ef-36e2-4705-890a-9da92f9b2abe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.903937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449bcf-5d4d-439f-9671-39f19f6a3917 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.917396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.936801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.937438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.937758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.938564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.939369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=7835f273e70a411fa7f8ee57395861f3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:53.939779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.941241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.941756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.942569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.942852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.943132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.955865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 277/568] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/role_assignments?user.id=7835f273e70a411fa7f8ee57395861f3&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:53.956895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.969178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.972139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:53.994272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:53.995237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:53.996280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:53.996280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:53.996280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:53.996280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:54.001065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 292/569] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:54.002052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.077128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02213e5e-cfad-4c24-a4be-d2109795a38a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.084684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.112760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6851f88-12bd-41a3-943e-44e75e263ffc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.114480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.115164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.115447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.116359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.116621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.116983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.118416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.136962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 278/570] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:54.142476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.154040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208cccd-2379-4b40-a194-f2080041294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.155396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208cccd-2379-4b40-a194-f2080041294e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.155682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208cccd-2379-4b40-a194-f2080041294e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.156009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208cccd-2379-4b40-a194-f2080041294e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.169544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208cccd-2379-4b40-a194-f2080041294e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0208cccd-2379-4b40-a194-f2080041294e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:54.180346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.181473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:54.182648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 293/571] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:54.183496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f941-4bdb-417c-afd4-dbc5f82bf807 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.183496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f941-4bdb-417c-afd4-dbc5f82bf807 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.183681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f941-4bdb-417c-afd4-dbc5f82bf807 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.187009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 294/572] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:54.187157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.187253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381f941-4bdb-417c-afd4-dbc5f82bf807 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.253297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46afee-ddfc-473c-9926-256ba2c36ba0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.290637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381f941-4bdb-417c-afd4-dbc5f82bf807 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.294411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.295075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.295357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.295632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.296452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.296758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.298838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.314975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 279/573] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:54.314975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.335544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c7abd-04fb-465c-8ee9-5dbd5b9adf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.336294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c7abd-04fb-465c-8ee9-5dbd5b9adf24 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.336576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c7abd-04fb-465c-8ee9-5dbd5b9adf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.336852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c7abd-04fb-465c-8ee9-5dbd5b9adf24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.339193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.349196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c7abd-04fb-465c-8ee9-5dbd5b9adf24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.350630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c7abd-04fb-465c-8ee9-5dbd5b9adf24 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-be0c7abd-04fb-465c-8ee9-5dbd5b9adf24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:54.368845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.369927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.370831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:54.370831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:54.370831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:54.370831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:54.370831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 295/574] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:54.371653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43162-116c-4723-adb2-3acee86f3ce7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.372034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43162-116c-4723-adb2-3acee86f3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.372316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa43162-116c-4723-adb2-3acee86f3ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.390854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3aa43162-116c-4723-adb2-3acee86f3ce7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:54.392080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3aa43162-116c-4723-adb2-3acee86f3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:54.415532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.419899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20fb3-dd36-4894-8b4f-1339ab9221ba None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.455886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.456653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.456999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.457340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.458079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.458382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.459783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.468435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 296/575] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:54.468435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa43162-116c-4723-adb2-3acee86f3ce7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.472012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 280/576] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:54.476968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.573728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa43162-116c-4723-adb2-3acee86f3ce7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.576431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25341d-cc3d-4bdc-8787-5c621380ca8a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.591172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.611961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.612862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.613144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.613413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.614122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.614422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.615534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.615765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.616487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.616834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.617379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.626959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.632473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 281/577] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:54.632621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.632714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:54.648278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.649327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 297/578] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:54.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.655675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.745415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19d694-74fa-464b-896a-6684df848c0d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.762811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810785f-8f76-47c5-b26c-5df59bd1d60d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.781325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.782280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.782656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.783050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.793341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.794864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.798272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ca31f-b353-4d31-9e1b-5a4e5c487bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.799048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca31f-b353-4d31-9e1b-5a4e5c487bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.799326 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca31f-b353-4d31-9e1b-5a4e5c487bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.799599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca31f-b353-4d31-9e1b-5a4e5c487bb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.809666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ca31f-b353-4d31-9e1b-5a4e5c487bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:54.814524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.815584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.816766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:54.816766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:54.816766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:54.816766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e61ca31f-b353-4d31-9e1b-5a4e5c487bb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:54.817785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:54.819730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:54.820534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 282/579] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:54.821325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.827939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 298/580] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:54.827939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ca31f-b353-4d31-9e1b-5a4e5c487bb6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.864505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.900561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.942925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ca31f-b353-4d31-9e1b-5a4e5c487bb6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.946808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb2b7f-d264-4b1b-815e-aff411c03d0a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.993751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.994708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.994895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.995304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.995731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.996009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.996385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.996750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.997271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.997737 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.999499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.004978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.006536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:55.022730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:55.023891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:55.025000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:55.025000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:55.025000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:55.025000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:55.025000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:55.025000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:55.025000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:55.025000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:55.026448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 299/581] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.032139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.045105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 283/582] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:55.045105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.193394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868560-c3d5-493a-9ee5-914a9c09eea4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.203957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.212504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e593588-c10c-4e4d-81fa-febdd2dd346d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.243994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.252728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.255890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.255890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.255890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.255890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.255890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.256984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.257404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.258910 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.259531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.260905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.262419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.262842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.264770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.269753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 284/583] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.270931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.280655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 300/584] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.281642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.379709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ceb51-d09e-4071-a85c-c5c58b698d87 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.387799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718b50-ac2e-41c9-a7f2-8c1e3890a4d9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.415340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.416301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.416645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.416989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.423588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.424265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.424552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.424828 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.425611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.425925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.427350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.427937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.429401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.444506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 301/585] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.445080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:55.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:55.447383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:55.452816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:55.452816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:55.452816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:55.452816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:55.452816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 285/586] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:55.452816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.468289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.498353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.554345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ac16-1fc8-4b58-b1f9-08f90d2062fa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.561674 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b926fe-8517-4c72-906c-937d54846004 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.588881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.589830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.590214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.590583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.598847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.599631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.599924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.600152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.600247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.601768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.610453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.611862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:55.616460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:55.617370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:55.618278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:55.622545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 286/587] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:55.623142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:55.631207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:55.632329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:55.633231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:55.633231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:55.633231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:55.633231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:55.633231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 302/588] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:55.633497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.700725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.736083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7b05-8c3c-427e-b7e4-3abd5f92c6e2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.739535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7889e6-c163-4f88-a022-257bb1e82794 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.747547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.773232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.773887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.774166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.774469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.775147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.775448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.776821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.776922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e764413-cda1-4ef7-987b-d4cceb346866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.777755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e764413-cda1-4ef7-987b-d4cceb346866 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.778043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e764413-cda1-4ef7-987b-d4cceb346866 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.778314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e764413-cda1-4ef7-987b-d4cceb346866 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/17d6317775c343eaa9397254074647f5/roles/027b6713998845388cfa9f77e136eb9e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.788282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 303/589] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.793037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.793500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e764413-cda1-4ef7-987b-d4cceb346866 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=17d6317775c343eaa9397254074647f5, role_id=027b6713998845388cfa9f77e136eb9e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.794937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e764413-cda1-4ef7-987b-d4cceb346866 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.849765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 287/590] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:55 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/17d6317775c343eaa9397254074647f5/roles/027b6713998845388cfa9f77e136eb9e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:55.856212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e764413-cda1-4ef7-987b-d4cceb346866 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.916529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1614bb-a731-44b1-8786-d6c5ac1f5f95 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.950257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.961190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.961971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.962360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.962969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.964103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.964524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.966095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.984471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e764413-cda1-4ef7-987b-d4cceb346866 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.991658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 304/591] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.992940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.025707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.026516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.026864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.027208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.028073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:56.028455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.029962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.045026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 288/592] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:56.046041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.070007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.129049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9bbab-23f0-41b6-8dce-45dc51007dbd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.154795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282bdde-2866-4e6a-94c0-77dc391cde8c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.166887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.167762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.168242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.168589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.177817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.179263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.190634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324f5c9-efec-4faa-afc6-b2f0062bc17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.191425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324f5c9-efec-4faa-afc6-b2f0062bc17c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.191710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324f5c9-efec-4faa-afc6-b2f0062bc17c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.192025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324f5c9-efec-4faa-afc6-b2f0062bc17c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:56.193597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:56.194595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:56.195659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:56.195659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:56.195659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:56.195659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:56.195659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:56.195659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:56.195659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:56.195659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:56.197485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 305/593] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:56.198340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.210758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324f5c9-efec-4faa-afc6-b2f0062bc17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.212300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324f5c9-efec-4faa-afc6-b2f0062bc17c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d324f5c9-efec-4faa-afc6-b2f0062bc17c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:56.231282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:56.232239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:56.233152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:56.233152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:56.233152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:56.233152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:56.233152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 289/594] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:56.234066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7510b3-16c7-48da-901d-adacc395c4eb None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.234355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7510b3-16c7-48da-901d-adacc395c4eb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.234658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7510b3-16c7-48da-901d-adacc395c4eb None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.236570 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 290/595] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:56.237116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7510b3-16c7-48da-901d-adacc395c4eb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.255956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.309866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.316193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffba3d-3a8b-4bfa-9f61-557ca4ac3b93 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.346955 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7510b3-16c7-48da-901d-adacc395c4eb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.352250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.353041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.353321 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.353599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.362169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.363631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:56.378819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:56.380586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:56.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:56.384903 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 306/596] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:56.385739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.387024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6a4d1-e29f-4020-9d62-b85fea80f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.387693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a4d1-e29f-4020-9d62-b85fea80f638 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.388009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a4d1-e29f-4020-9d62-b85fea80f638 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.388292 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6a4d1-e29f-4020-9d62-b85fea80f638 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.389077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6a4d1-e29f-4020-9d62-b85fea80f638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:56.389391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6a4d1-e29f-4020-9d62-b85fea80f638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.390814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6a4d1-e29f-4020-9d62-b85fea80f638 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.403989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 291/597] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:56.408352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd1721-b3f6-4284-9d1f-774b6894730a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.408640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd1721-b3f6-4284-9d1f-774b6894730a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.409051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd1721-b3f6-4284-9d1f-774b6894730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.426362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-49dd1721-b3f6-4284-9d1f-774b6894730a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:56.427697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-49dd1721-b3f6-4284-9d1f-774b6894730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:56.500038 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 292/598] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:56.500038 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd1721-b3f6-4284-9d1f-774b6894730a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.513156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999bbdc-f553-4f3e-9fb0-7900ad6712fd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.516650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.557629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.558269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.558682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.559362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.559743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.560867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:56.561285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.563489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.576394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 307/599] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:56.577195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.606750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd1721-b3f6-4284-9d1f-774b6894730a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.645468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.646139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.646422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.646701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.647532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:56.647842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.649362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.666761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 293/600] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:56.667568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.700597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57189688-c53a-42f7-8ef8-a6b80958660f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.745984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259851-6336-4fc4-8640-8ffe03658611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.747060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259851-6336-4fc4-8640-8ffe03658611 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.747346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259851-6336-4fc4-8640-8ffe03658611 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.747627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259851-6336-4fc4-8640-8ffe03658611 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/ad41d031778c4e8ebc8c176c3670f4b2/roles/027b6713998845388cfa9f77e136eb9e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.763158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47259851-6336-4fc4-8640-8ffe03658611 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=ad41d031778c4e8ebc8c176c3670f4b2, role_id=027b6713998845388cfa9f77e136eb9e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.764566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47259851-6336-4fc4-8640-8ffe03658611 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.776713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041125-d58d-4c5f-af2c-dce087d98eda None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.794030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.810527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2f4fa-5667-433a-bc8b-399a8e850a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.811304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f4fa-5667-433a-bc8b-399a8e850a1e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.811632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f4fa-5667-433a-bc8b-399a8e850a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.811960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f4fa-5667-433a-bc8b-399a8e850a1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.821556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2f4fa-5667-433a-bc8b-399a8e850a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-aaa2f4fa-5667-433a-bc8b-399a8e850a1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:56.829685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:56.830581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:56.831401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 294/601] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:56.832140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2f4fa-5667-433a-bc8b-399a8e850a1e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.866506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 308/602] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:56 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/ad41d031778c4e8ebc8c176c3670f4b2/roles/027b6713998845388cfa9f77e136eb9e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:56.868313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259851-6336-4fc4-8640-8ffe03658611 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.887314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.964960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2f4fa-5667-433a-bc8b-399a8e850a1e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.006735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.008059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.008992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.009475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.014610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259851-6336-4fc4-8640-8ffe03658611 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.019552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.021549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:57.039465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:57.040777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:57.041855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:57.041855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:57.041855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:57.041855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:57.041855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:57.041855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:57.041855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:57.041855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:57.043409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 295/603] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:57.044154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.055066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.055868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.056182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.056461 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.068946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.070403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.088232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:57.099477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:57.103765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:57.104688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:57.104688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:57.104688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:57.104688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:57.104688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 309/604] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:57.104688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.164160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac561ad-bdd9-408d-bd39-cec38215e0ac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.190661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:57.202243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.203112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.203574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.204102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.205018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:57.205472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.206970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.216002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 296/605] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:57.216989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.235993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e3cd-dc87-43c8-8f13-48b175a737ec None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.284419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.285124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.285662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.285933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.286727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:57.287042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.288766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.307941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 310/606] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:57.307941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.325520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:57.330030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a2464-7c75-496d-941d-39cf827980f1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.372091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.372819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.373161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.373440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.374221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:57.374536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.375939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.392951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 297/607] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:57.392951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.448952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d992c0-c39e-44ab-a796-b44e7fa7a77b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.484097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:57.496677 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.497652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.498108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.498377 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa488-dfac-4a3a-b1fd-e15f8662e62d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.498680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.512856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.515236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.537122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1e9ea-6b9a-42fe-8ecc-f6ec6485962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.538075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e9ea-6b9a-42fe-8ecc-f6ec6485962b None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.538467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e9ea-6b9a-42fe-8ecc-f6ec6485962b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.538854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1e9ea-6b9a-42fe-8ecc-f6ec6485962b None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/4033fb5bc0624281a97a979a75ce13e9/roles/027b6713998845388cfa9f77e136eb9e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:57.540314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:57.541313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:57.542413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:57.542413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:57.542413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:57.542413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:57.549316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 311/608] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:57.549316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.561346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1e9ea-6b9a-42fe-8ecc-f6ec6485962b None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=4033fb5bc0624281a97a979a75ce13e9, role_id=027b6713998845388cfa9f77e136eb9e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.563036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1e9ea-6b9a-42fe-8ecc-f6ec6485962b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.660417 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bc3d8-26ec-49a6-9c2b-4e445d849c9e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.664723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 298/609] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:57 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/4033fb5bc0624281a97a979a75ce13e9/roles/027b6713998845388cfa9f77e136eb9e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:57.667003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1e9ea-6b9a-42fe-8ecc-f6ec6485962b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.695711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:57.726966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.728973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.730140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.730611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.750967 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.756293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:57.784441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:57.785503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:57.786595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:57.786595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:57.786595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:57.786595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:57.786595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:57.786595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:57.786595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:57.786595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:57.794483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 312/610] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:57.800823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.881244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:57.889942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1e9ea-6b9a-42fe-8ecc-f6ec6485962b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.938487 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.939473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.940025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.940308 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.941186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:57.941495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.943407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.947336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d4529-e163-4197-a873-3eda1da0c56a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.957494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 299/611] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:57.964033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.993602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.994472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.994748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.995009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.995849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:57.996194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.997894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.012026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 313/612] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:58.021098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.043974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.094934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9637222-1ec3-4f44-b2b4-03055f076b11 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.132939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53370fd8-262f-4cbb-a7a1-41905e9409ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.134203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370fd8-262f-4cbb-a7a1-41905e9409ec None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.134550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370fd8-262f-4cbb-a7a1-41905e9409ec None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.134898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370fd8-262f-4cbb-a7a1-41905e9409ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.143723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370fd8-262f-4cbb-a7a1-41905e9409ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.145307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370fd8-262f-4cbb-a7a1-41905e9409ec None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-53370fd8-262f-4cbb-a7a1-41905e9409ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:58.162139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:58.163269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:58.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:58.165151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 300/613] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:58.166182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.166978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cffa6-a115-4a4b-bc51-549802fd980e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.167264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cffa6-a115-4a4b-bc51-549802fd980e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.167543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cffa6-a115-4a4b-bc51-549802fd980e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.173406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 301/614] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:58.173406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cffa6-a115-4a4b-bc51-549802fd980e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.179384 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cba6f-b3d2-4d79-8e3f-f4602537a665 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.216265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e817f-4a8f-48d1-8a22-b6b6ad7ac935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.217465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e817f-4a8f-48d1-8a22-b6b6ad7ac935 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.217895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e817f-4a8f-48d1-8a22-b6b6ad7ac935 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.218354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e817f-4a8f-48d1-8a22-b6b6ad7ac935 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/1eaffae68edd4031ac771310b7d645cc/roles/027b6713998845388cfa9f77e136eb9e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.234871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e817f-4a8f-48d1-8a22-b6b6ad7ac935 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=1eaffae68edd4031ac771310b7d645cc, role_id=027b6713998845388cfa9f77e136eb9e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.236770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e817f-4a8f-48d1-8a22-b6b6ad7ac935 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.290238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cffa6-a115-4a4b-bc51-549802fd980e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.308388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 314/615] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:58 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/1eaffae68edd4031ac771310b7d645cc/roles/027b6713998845388cfa9f77e136eb9e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:58.310076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a9a9-620f-4968-872d-c62861562ef2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.310748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a9a9-620f-4968-872d-c62861562ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.311831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a9a9-620f-4968-872d-c62861562ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.319653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.329581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.330314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.330599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.330874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.331736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:58.332065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.333575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.337955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cea3a9a9-620f-4968-872d-c62861562ef2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:58.339451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cea3a9a9-620f-4968-872d-c62861562ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:58.368036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 302/616] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:58.373524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.432778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 315/617] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:58.453897 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3a9a9-620f-4968-872d-c62861562ef2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.550845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.576904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a70c-1a4e-488b-9a2e-62a5659cfb13 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.589086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3a9a9-620f-4968-872d-c62861562ef2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.620794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.622104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.622572 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.623134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.632795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4453bd-8982-4893-bf6e-a37070dc4f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.633943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4453bd-8982-4893-bf6e-a37070dc4f7c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.634304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4453bd-8982-4893-bf6e-a37070dc4f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.634654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4453bd-8982-4893-bf6e-a37070dc4f7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.637965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.639602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.646569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4453bd-8982-4893-bf6e-a37070dc4f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-3d4453bd-8982-4893-bf6e-a37070dc4f7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:58.654878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:58.656075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:58.657322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:58.659946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 316/618] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:58.664482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4453bd-8982-4893-bf6e-a37070dc4f7c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:58.665952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:58.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:58.668194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:58.668194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:58.668194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:58.668194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:58.669333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 303/619] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:58.674867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.717405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.786259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f1de-aa99-430e-a26a-3d38fac35bcc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.800588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4453bd-8982-4893-bf6e-a37070dc4f7c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.841281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.841960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.842242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.842518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.843248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:58.843554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.845088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.849154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.849154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.849419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.849632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.850354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:58.850658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.852057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.863680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.879647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 317/620] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:58.879815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 304/621] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:58.879933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.880969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.020502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:59.027489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150f39-5768-4c1f-bd76-1b01b389657d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.033607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e65b8-4f5b-4816-88f8-846873771a45 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.094780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.095582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.095857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.096151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.097353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.098134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.098407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.098673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.111533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.113012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.116068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.117523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:59.128063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:59.128986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:22:59.129919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 305/622] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:59.138908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:59.149351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:59.150253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:59.151158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:59.151158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:59.151158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:59.151158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:59.159938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 318/623] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:59.159938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.262459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:59.315034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e8a84-a155-41d3-8bd5-c23c35303374 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.338159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b4ff8-1609-4907-92ae-9ae03f1c82e1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.374713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad5b1-783a-45e1-b617-f940e3b59b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.375934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad5b1-783a-45e1-b617-f940e3b59b96 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.376242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad5b1-783a-45e1-b617-f940e3b59b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.376519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad5b1-783a-45e1-b617-f940e3b59b96 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.377249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad5b1-783a-45e1-b617-f940e3b59b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:59.377556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad5b1-783a-45e1-b617-f940e3b59b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.378929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad5b1-783a-45e1-b617-f940e3b59b96 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.390204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae771ab-1de0-4ec7-a88d-b03f705d3e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.391724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae771ab-1de0-4ec7-a88d-b03f705d3e5d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.392171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 319/624] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:59.392487 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae771ab-1de0-4ec7-a88d-b03f705d3e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.392968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae771ab-1de0-4ec7-a88d-b03f705d3e5d None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.393475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfeafa-c5ca-4b15-b57e-7fb5486a4f06 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.393764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfeafa-c5ca-4b15-b57e-7fb5486a4f06 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.394045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfeafa-c5ca-4b15-b57e-7fb5486a4f06 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.394655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae771ab-1de0-4ec7-a88d-b03f705d3e5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:59.400660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 320/625] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:59.400822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae771ab-1de0-4ec7-a88d-b03f705d3e5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.400822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae771ab-1de0-4ec7-a88d-b03f705d3e5d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.400970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfeafa-c5ca-4b15-b57e-7fb5486a4f06 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.414955 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 306/626] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:59.416616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dffdf-70a9-45db-a890-cae64815a578 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.417113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dffdf-70a9-45db-a890-cae64815a578 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.417592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dffdf-70a9-45db-a890-cae64815a578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.435084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9d8dffdf-70a9-45db-a890-cae64815a578 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:59.436648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9d8dffdf-70a9-45db-a890-cae64815a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:59.451648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:59.511972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 307/627] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:59.513190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dffdf-70a9-45db-a890-cae64815a578 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.514657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfeafa-c5ca-4b15-b57e-7fb5486a4f06 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.528936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:59.550890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.551703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.552052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.552320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.561173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.563226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:59.579085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:59.580064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:59.581013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 321/628] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:59.581614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.640022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dffdf-70a9-45db-a890-cae64815a578 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.676835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3086ee-3226-4675-823f-218375647cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.678134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3086ee-3226-4675-823f-218375647cc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.678716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3086ee-3226-4675-823f-218375647cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.679191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3086ee-3226-4675-823f-218375647cc1 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/7835f273e70a411fa7f8ee57395861f3/roles/027b6713998845388cfa9f77e136eb9e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.688343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920d079-fa6a-4392-bcae-ec0bb1f52eb4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.695384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3086ee-3226-4675-823f-218375647cc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=7835f273e70a411fa7f8ee57395861f3, role_id=027b6713998845388cfa9f77e136eb9e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.697216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3086ee-3226-4675-823f-218375647cc1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.725336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f2b8-8ec8-444e-ae4b-520bd8d82699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.726146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f2b8-8ec8-444e-ae4b-520bd8d82699 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.726552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f2b8-8ec8-444e-ae4b-520bd8d82699 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.726839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189f2b8-8ec8-444e-ae4b-520bd8d82699 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.739089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189f2b8-8ec8-444e-ae4b-520bd8d82699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8189f2b8-8ec8-444e-ae4b-520bd8d82699 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:59.746858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:59.748641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 322/629] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:59.749516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f2b8-8ec8-444e-ae4b-520bd8d82699 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.768551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:59.773341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 308/630] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:59 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/7835f273e70a411fa7f8ee57395861f3/roles/027b6713998845388cfa9f77e136eb9e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:59.776565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3086ee-3226-4675-823f-218375647cc1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.822542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:59.897334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3086ee-3226-4675-823f-218375647cc1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.940982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.941777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.942158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.942534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.943395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:59.943818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.945818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.955466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 309/631] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:59.961391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.032272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189f2b8-8ec8-444e-ae4b-520bd8d82699 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.036549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.075109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.075950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.076345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.076891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.077856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:00.078956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.080526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.090753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde7434-6cd6-4628-8382-f723d36f27ae None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.103432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 323/632] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:00.109009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.131295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.132168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.132505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.132785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.144962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.146407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:00.165019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:00.166127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:00.167220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:00.167220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:00.167220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:00.167220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:00.167220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 310/633] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:00.172744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.282879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c7431-2c2c-4b5c-9ccb-1477b69a339c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.304380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.313338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.318240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50703a5-7dc9-476e-af79-68b4c3b4f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.318974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50703a5-7dc9-476e-af79-68b4c3b4f253 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.319255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50703a5-7dc9-476e-af79-68b4c3b4f253 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.319578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50703a5-7dc9-476e-af79-68b4c3b4f253 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.320512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50703a5-7dc9-476e-af79-68b4c3b4f253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:00.323202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50703a5-7dc9-476e-af79-68b4c3b4f253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.323202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50703a5-7dc9-476e-af79-68b4c3b4f253 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.323385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb5155-7f01-45a4-93be-354497766c92 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.335232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 311/634] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:00.340869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0323fb-5893-44a6-9a27-2147fdf73eb8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.341166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0323fb-5893-44a6-9a27-2147fdf73eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.341450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0323fb-5893-44a6-9a27-2147fdf73eb8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.342748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 312/635] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:00.344565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0323fb-5893-44a6-9a27-2147fdf73eb8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.361263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bf32-5a10-4054-91d4-e0b294eea829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.362024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bf32-5a10-4054-91d4-e0b294eea829 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.362316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bf32-5a10-4054-91d4-e0b294eea829 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.362584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27bf32-5a10-4054-91d4-e0b294eea829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.447728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27bf32-5a10-4054-91d4-e0b294eea829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.449627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27bf32-5a10-4054-91d4-e0b294eea829 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.453587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0323fb-5893-44a6-9a27-2147fdf73eb8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.496552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63f475-2b2b-471d-9e77-1cb1e1dbf790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.497390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f475-2b2b-471d-9e77-1cb1e1dbf790 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.497671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f475-2b2b-471d-9e77-1cb1e1dbf790 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.497942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63f475-2b2b-471d-9e77-1cb1e1dbf790 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.511433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f475-2b2b-471d-9e77-1cb1e1dbf790 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.513840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63f475-2b2b-471d-9e77-1cb1e1dbf790 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6a63f475-2b2b-471d-9e77-1cb1e1dbf790 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:00.534379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:00.535405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:00.536365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 313/636] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:00.537358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab211a-b0bd-4d4e-8a2a-76306f55e6d4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.543931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab211a-b0bd-4d4e-8a2a-76306f55e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.543931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab211a-b0bd-4d4e-8a2a-76306f55e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.560540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fcab211a-b0bd-4d4e-8a2a-76306f55e6d4 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:00.561754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fcab211a-b0bd-4d4e-8a2a-76306f55e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:00.566290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.580649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 324/637] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:23:00.581627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bf32-5a10-4054-91d4-e0b294eea829 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.597089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.652105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 314/638] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:00.653071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab211a-b0bd-4d4e-8a2a-76306f55e6d4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.703064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27bf32-5a10-4054-91d4-e0b294eea829 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.747502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.748523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.748904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.749274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.750769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:00.751177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.752821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.773056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 325/639] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:00.773950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.781253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab211a-b0bd-4d4e-8a2a-76306f55e6d4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.831694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.833786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.834769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.835199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.835631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.851810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.853954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:00.875007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:00.875966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:00.876864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:00.876864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:00.876864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:00.876864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:00.876864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 315/640] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:00.877151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.888165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2dabb-de48-454e-b366-50fd98418c0e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.896348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.923656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c6ca5-0a84-43bf-8ac4-880eff3e9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.924473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6ca5-0a84-43bf-8ac4-880eff3e9049 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.924981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6ca5-0a84-43bf-8ac4-880eff3e9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.925109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c6ca5-0a84-43bf-8ac4-880eff3e9049 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.937652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c6ca5-0a84-43bf-8ac4-880eff3e9049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ce4c6ca5-0a84-43bf-8ac4-880eff3e9049 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:00.946016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:00.947004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:00.947864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 326/641] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:00.949127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18523ac-ef69-426d-84be-6aa507a1e780 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.949127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18523ac-ef69-426d-84be-6aa507a1e780 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.949127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18523ac-ef69-426d-84be-6aa507a1e780 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.954357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 327/642] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:00.954357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18523ac-ef69-426d-84be-6aa507a1e780 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.997914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c95c4c-773d-47c6-82e8-c3544f418c55 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.034065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef358c1-5f2c-485c-8e8c-693cb6f490cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.034711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef358c1-5f2c-485c-8e8c-693cb6f490cc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.034997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef358c1-5f2c-485c-8e8c-693cb6f490cc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.035273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef358c1-5f2c-485c-8e8c-693cb6f490cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.063727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18523ac-ef69-426d-84be-6aa507a1e780 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.073506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.099436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.100241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.100530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.100802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.101522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:01.101825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.103318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.114926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef358c1-5f2c-485c-8e8c-693cb6f490cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.116389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef358c1-5f2c-485c-8e8c-693cb6f490cc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.121368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 328/643] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:01.121368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.132836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.223259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 316/644] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:23:01.225969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ea48-5047-4347-b136-7bed99a8a6cc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.226774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ea48-5047-4347-b136-7bed99a8a6cc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.227741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ea48-5047-4347-b136-7bed99a8a6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.230070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a4d09-4ca4-4442-b99a-cb957dd720f4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.246313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ab02ea48-5047-4347-b136-7bed99a8a6cc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:01.247499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ab02ea48-5047-4347-b136-7bed99a8a6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:01.266113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.266773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.267052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.267322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.268091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:01.268397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.269784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.278373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 329/645] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:01.279158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.314532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.321248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 317/646] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:01.321920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ea48-5047-4347-b136-7bed99a8a6cc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.376541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.391117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23e965-f09e-4b2b-bfb7-f3cf1fc78d7c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.426932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.427730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.428045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.428319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.432136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ea48-5047-4347-b136-7bed99a8a6cc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.434840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.436286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:01.450959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:01.451843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 330/647] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:01.458366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.472041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.472911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.473254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.473588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.483992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.486244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:01.506238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:01.507318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:01.508449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:01.508449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:01.508449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:01.508449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:01.514567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 318/648] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:01.514567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.556195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.565961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae76b0-a3bd-40d7-a9e3-c0d7efc609ab None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.603036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.603824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.604129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.604405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.608239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.614519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94dde2-4124-4bfc-8b59-19ab021391f7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.618707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.620300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:01.642561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:01.643526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:01.644503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:01.644503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:01.644503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:01.644503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:01.644503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 331/649] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:01.645064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.662041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e0ed-2231-4bda-851e-6e44d2fc4a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.662831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e0ed-2231-4bda-851e-6e44d2fc4a66 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.663111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e0ed-2231-4bda-851e-6e44d2fc4a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.663384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422e0ed-2231-4bda-851e-6e44d2fc4a66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.677302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422e0ed-2231-4bda-851e-6e44d2fc4a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c422e0ed-2231-4bda-851e-6e44d2fc4a66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:01.687255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:01.693532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 319/650] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:01.694571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e0ed-2231-4bda-851e-6e44d2fc4a66 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.761636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5548-4bcc-4e12-a5f2-e3a4aaf41bb0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.797942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.798603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.798968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.799213 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.800028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:01.800393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.801860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.806794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422e0ed-2231-4bda-851e-6e44d2fc4a66 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.819287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 332/651] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:01.819287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.819287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.845172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.845828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.846105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.846382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.847560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:01.847866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.849266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.861434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 320/652] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:01.862371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.880417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.928825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e128ca1-48f0-4178-beae-a050b0a10ae7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.962529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.963101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.963385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.963661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.964411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:01.964723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.966081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.971189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c42b1e-d0eb-4c0f-9931-b44c94bac287 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.979146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 333/653] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:01.979971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.010599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.011585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.012081 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.012742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.013596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:02.013903 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.015260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.028061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 321/654] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:02.028061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.051002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.091603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeebf84-b490-4550-b0ff-21d88e849fdd None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.111814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.130575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.131289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.131570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.131842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.132717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=17d6317775c343eaa9397254074647f5) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:02.133029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.134883 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.138579 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3d6b-2577-4789-9e19-b74177c5a9c2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.141649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 334/655] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/role_assignments?user.id=17d6317775c343eaa9397254074647f5&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:02.142522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.200475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.201212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.201500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.201776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.210590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.212103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:02.227375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:02.228514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:02.229554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 322/656] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:02.230127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.269157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acff13f-ba46-4c8f-88eb-052b23e6f439 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.295545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.305608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2e36c-6c18-448d-b152-3a0327ae6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.306405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2e36c-6c18-448d-b152-3a0327ae6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.310018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2e36c-6c18-448d-b152-3a0327ae6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.310018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2e36c-6c18-448d-b152-3a0327ae6bc1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.316431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2e36c-6c18-448d-b152-3a0327ae6bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.317882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2e36c-6c18-448d-b152-3a0327ae6bc1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-30d2e36c-6c18-448d-b152-3a0327ae6bc1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:02.334201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:02.335360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:02.336466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 335/657] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:02.337422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729630eb-b75a-497a-ac90-ba3a26eec253 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.337711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729630eb-b75a-497a-ac90-ba3a26eec253 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.337990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729630eb-b75a-497a-ac90-ba3a26eec253 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.339776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 336/658] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:02.339995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729630eb-b75a-497a-ac90-ba3a26eec253 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.353587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a64a-22cd-42ed-85f4-38a442d4d98f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.393642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.395220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.395687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.395985 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.402721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.407571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.409256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:02.427619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:02.428661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:02.429574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:02.429574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:02.429574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:02.429574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:02.429574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 323/659] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:02.429851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.459626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729630eb-b75a-497a-ac90-ba3a26eec253 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.497739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc813b-5fc1-4746-a3cc-41f1cdb87a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.498541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc813b-5fc1-4746-a3cc-41f1cdb87a8f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.498943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc813b-5fc1-4746-a3cc-41f1cdb87a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.499226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc813b-5fc1-4746-a3cc-41f1cdb87a8f None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.500076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc813b-5fc1-4746-a3cc-41f1cdb87a8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:02.500393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc813b-5fc1-4746-a3cc-41f1cdb87a8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.501939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc813b-5fc1-4746-a3cc-41f1cdb87a8f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.514620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 337/660] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:02.515936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663add-e59d-4f7f-afea-fbbcc8214861 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.516233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663add-e59d-4f7f-afea-fbbcc8214861 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.516514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12663add-e59d-4f7f-afea-fbbcc8214861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.533958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-12663add-e59d-4f7f-afea-fbbcc8214861 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:02.535319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-12663add-e59d-4f7f-afea-fbbcc8214861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:02.537483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e22a9e-a9b2-4538-b445-3f16e77aaf35 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.571408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.572069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.572353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.572632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.573467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:02.573778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.575195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.580203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.597429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 324/661] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:02.597429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.611250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 338/662] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:02.616793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12663add-e59d-4f7f-afea-fbbcc8214861 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.654162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.712294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc2376-1d7a-4ac0-b55e-cca9e7a504d3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.726757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12663add-e59d-4f7f-afea-fbbcc8214861 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.750546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.751217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.751499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.751777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.752528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:02.752833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.754183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.766547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.767196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.767473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.767744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.772607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 325/663] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:02.772735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=ad41d031778c4e8ebc8c176c3670f4b2) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:02.772735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.772890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.772973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.777783 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 339/664] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/role_assignments?user.id=ad41d031778c4e8ebc8c176c3670f4b2&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:02.778792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.837279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.905506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa050f-7902-487d-b440-00b255aa37a0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.914200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb8c2c-0868-4126-b360-65816a104770 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.925412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.944397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0313d32-e941-43bd-8045-f306d4f755ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.945200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0313d32-e941-43bd-8045-f306d4f755ef None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.945564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0313d32-e941-43bd-8045-f306d4f755ef None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.945841 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0313d32-e941-43bd-8045-f306d4f755ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.955531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b647a58-06b3-408c-be79-38755c11c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.956815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b647a58-06b3-408c-be79-38755c11c79a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.957449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b647a58-06b3-408c-be79-38755c11c79a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.958044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b647a58-06b3-408c-be79-38755c11c79a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.958917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0313d32-e941-43bd-8045-f306d4f755ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e0313d32-e941-43bd-8045-f306d4f755ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:02.967103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:02.968084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:02.969502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 340/665] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:02.970196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0313d32-e941-43bd-8045-f306d4f755ef None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.042868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b647a58-06b3-408c-be79-38755c11c79a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.044917 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b647a58-06b3-408c-be79-38755c11c79a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.081657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.086093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0313d32-e941-43bd-8045-f306d4f755ef None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.129042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.130286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.130789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.131677 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.144028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.146166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.164597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 326/666] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:23:03.166083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b647a58-06b3-408c-be79-38755c11c79a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:03.170952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:03.171933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 341/667] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:03.172881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.186900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.285022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b647a58-06b3-408c-be79-38755c11c79a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.307343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a342d9b-f93b-4249-9fab-b1b9a48506de None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.322364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.323054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.323338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.323612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.324404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:03.324714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.326154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.336027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 327/668] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:03.336956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.356517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.358421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.358919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.360064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.374734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.376604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:03.395476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:03.396429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:03.397296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:03.397296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:03.397296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:03.397296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:03.399404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 342/669] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:03.400404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.418498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.421000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.451669 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05f750-a292-47fa-924b-a05c0d5519ff None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.489699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.490428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.490731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.491014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.491832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:03.492242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.493782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.513048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 328/670] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:03.513433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7aaf-47d7-47fd-b360-d9b66303dd5e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.513868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.550781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.552015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.552513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.552978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.564322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.566078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:03.584719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:03.585596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:03.586462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:03.586462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:03.586462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:03.586462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:03.588868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 343/671] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:03.589842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.624756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d91cd-6812-41ad-8463-fc5e1c9951ee None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.655209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.659355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.664988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.665836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.666260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.666676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.667602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:03.668078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.669636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.682605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 329/672] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:03.683699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.700606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1dc22-ee7f-47bd-b37a-4beea1e03d7c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.745860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d46746-496e-4143-8f67-7915496a21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.746640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d46746-496e-4143-8f67-7915496a21e6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.747038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d46746-496e-4143-8f67-7915496a21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.747530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d46746-496e-4143-8f67-7915496a21e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.793065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be92c2b-4ca9-4a6c-9119-c8b09feee930 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.821680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d46746-496e-4143-8f67-7915496a21e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.823289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d46746-496e-4143-8f67-7915496a21e6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.830235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.831086 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.831509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.832043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.832936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:03.833413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.835047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.853145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 330/673] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:03.854350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.887866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.907667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.929173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 344/674] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:23:03.930829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d46746-496e-4143-8f67-7915496a21e6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.961964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145efaf4-022d-4735-94e3-a57e82ce96fb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.999806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.001605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.002066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.002580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.010339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.012145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:04.027948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:04.028896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:04.029749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:04.029749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:04.029749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:04.029749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:04.029749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:04.029749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:04.029749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:04.029749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:04.033021 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 331/675] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:04.034233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.037188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d46746-496e-4143-8f67-7915496a21e6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.075973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.076632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.076910 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.077182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.085363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.086789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:04.102485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:04.103439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:23:04.104405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:04.108363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 345/676] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:04.109188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.135703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.154550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aca9a-8427-4c80-b41d-b4c3056292a8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.167452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.200991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.202191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.203781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.204327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.215954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dbe9f-a19b-4a7c-96da-f95a15b6f8c2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.221410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.223156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:04.247212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:04.248176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:04.249071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:04.249071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:04.249071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:04.249071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:04.249844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 332/677] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:04.250359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.259591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.260311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.260592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.260868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.261774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:04.262091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.263513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.278046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 346/678] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:04.279115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.366324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.374362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea057f2-e1b4-4259-be00-913edb236bc9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.387969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c60e66-8fb4-4a4f-9231-ea3ca9570fc7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.411623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.412322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.412605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.412880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.413713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:04.414024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.415441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.418338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4456dfb-e30d-4420-b17a-bf81ac5bedaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.419404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456dfb-e30d-4420-b17a-bf81ac5bedaf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.420053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456dfb-e30d-4420-b17a-bf81ac5bedaf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.420882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456dfb-e30d-4420-b17a-bf81ac5bedaf None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.421666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4456dfb-e30d-4420-b17a-bf81ac5bedaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:04.422067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4456dfb-e30d-4420-b17a-bf81ac5bedaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.423464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4456dfb-e30d-4420-b17a-bf81ac5bedaf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.433282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 333/679] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:04.434115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.446489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 347/680] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:04.446489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd1ee-406d-4946-ac1f-7172a6822a21 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.446489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd1ee-406d-4946-ac1f-7172a6822a21 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.446489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd1ee-406d-4946-ac1f-7172a6822a21 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.446489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 348/681] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:04.446489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bd1ee-406d-4946-ac1f-7172a6822a21 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.454370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.544897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d399-85a8-4d9c-b617-2138bcaf9d34 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.555548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bd1ee-406d-4946-ac1f-7172a6822a21 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.583302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.583999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.584332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.584616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.585449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=4033fb5bc0624281a97a979a75ce13e9) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:04.585758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.587186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.590496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c22b0-4a82-4141-b14e-5f71a1eeb465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.591300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c22b0-4a82-4141-b14e-5f71a1eeb465 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.591738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c22b0-4a82-4141-b14e-5f71a1eeb465 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.592197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c22b0-4a82-4141-b14e-5f71a1eeb465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.593148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 334/682] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/role_assignments?user.id=4033fb5bc0624281a97a979a75ce13e9&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:04.593917 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.614259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.696566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c22b0-4a82-4141-b14e-5f71a1eeb465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.698263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c22b0-4a82-4141-b14e-5f71a1eeb465 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.713093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.747981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cf27-8c37-4f6a-97aa-06877124e394 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.791680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98407e-bdd6-489d-9aa2-3b2566fb8965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.792514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98407e-bdd6-489d-9aa2-3b2566fb8965 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.793414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98407e-bdd6-489d-9aa2-3b2566fb8965 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.793414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98407e-bdd6-489d-9aa2-3b2566fb8965 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.801894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98407e-bdd6-489d-9aa2-3b2566fb8965 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.803837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98407e-bdd6-489d-9aa2-3b2566fb8965 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5e98407e-bdd6-489d-9aa2-3b2566fb8965 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:04.819209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:04.820351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:04.821466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:04.821466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:04.821466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:04.821466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:04.821466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:04.821466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:04.821466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:04.821466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:04.824013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 335/683] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:04.825641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8300-4502-4e10-9ce6-122834e861af None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.825916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8300-4502-4e10-9ce6-122834e861af None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.826353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e8300-4502-4e10-9ce6-122834e861af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.838624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 349/684] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:23:04.839479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c22b0-4a82-4141-b14e-5f71a1eeb465 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.845884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e56e8300-4502-4e10-9ce6-122834e861af None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:04.847366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e56e8300-4502-4e10-9ce6-122834e861af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:04.899492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.919830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 336/685] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:04.921389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e8300-4502-4e10-9ce6-122834e861af None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.973738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c22b0-4a82-4141-b14e-5f71a1eeb465 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.999380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.009291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.010195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.010195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.010487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.011283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:05.011614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.013062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.026927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 350/686] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:05.027747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.034448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e8300-4502-4e10-9ce6-122834e861af None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.073650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.074968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.075450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.076039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.089518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.091806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:05.112112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:05.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:05.113969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:05.113969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:05.113969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:05.113969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:05.120203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 337/687] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:05.121428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.143377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef24b91-e485-4f74-b31f-4729d3d9f3d2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.145943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.180235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.181026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.181312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.181586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.193857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.195297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:05.217128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:05.218047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:05.219587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:05.219587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:05.219587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:05.219587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:05.220369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 351/688] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:05.220757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.235454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6fcd1-b9d6-47c3-8809-be194ff76a57 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.260982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.272510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0bb41-24f8-4ee4-8674-2510bf8f08b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.273356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0bb41-24f8-4ee4-8674-2510bf8f08b3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.273792 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0bb41-24f8-4ee4-8674-2510bf8f08b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.274069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0bb41-24f8-4ee4-8674-2510bf8f08b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.274919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0bb41-24f8-4ee4-8674-2510bf8f08b3 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=1eaffae68edd4031ac771310b7d645cc) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:05.275228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0bb41-24f8-4ee4-8674-2510bf8f08b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.276699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0bb41-24f8-4ee4-8674-2510bf8f08b3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.284034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 338/689] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/role_assignments?user.id=1eaffae68edd4031ac771310b7d645cc&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:05.285409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d6dc-7b64-4b26-b5d4-6bf9f0bf14a3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.288479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d6dc-7b64-4b26-b5d4-6bf9f0bf14a3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.288479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d6dc-7b64-4b26-b5d4-6bf9f0bf14a3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.288479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 339/690] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:05.288479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d6dc-7b64-4b26-b5d4-6bf9f0bf14a3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.354491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118752-aeca-4098-8188-6202e4b9c9a0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.394275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f501f65-d553-451e-88d3-5d621569ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.394959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501f65-d553-451e-88d3-5d621569ae81 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.395243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501f65-d553-451e-88d3-5d621569ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.395520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f501f65-d553-451e-88d3-5d621569ae81 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.396276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f501f65-d553-451e-88d3-5d621569ae81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:05.396642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f501f65-d553-451e-88d3-5d621569ae81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.398092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f501f65-d553-451e-88d3-5d621569ae81 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.412039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 352/691] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:05.413434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e468-9024-4bb9-b861-6f8121530829 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.413725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e468-9024-4bb9-b861-6f8121530829 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.414002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e468-9024-4bb9-b861-6f8121530829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.432784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1908e468-9024-4bb9-b861-6f8121530829 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:05.433119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d6dc-7b64-4b26-b5d4-6bf9f0bf14a3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.433991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1908e468-9024-4bb9-b861-6f8121530829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:05.446290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.472591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.473257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.473587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.473859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.474631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:05.474935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.476432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.489676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 340/692] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:05.490271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.512130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 353/693] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:05.513174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908e468-9024-4bb9-b861-6f8121530829 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.540954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.611549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59814be-af27-4adc-8ceb-ece1e3706e26 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.637961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908e468-9024-4bb9-b861-6f8121530829 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.647895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.648703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.648979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.649250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.656470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.658323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:05.672472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:05.673458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:05.674327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 341/694] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:05.674793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.682696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27391773-57e3-4eea-b71b-a03a587ab1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.684433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391773-57e3-4eea-b71b-a03a587ab1f8 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.684433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391773-57e3-4eea-b71b-a03a587ab1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.684626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391773-57e3-4eea-b71b-a03a587ab1f8 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.685317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27391773-57e3-4eea-b71b-a03a587ab1f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.688553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27391773-57e3-4eea-b71b-a03a587ab1f8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.780481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 354/695] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:23:05 2022] POST /identity/v3/users => generated 254 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:05.782525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27391773-57e3-4eea-b71b-a03a587ab1f8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.788532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.808802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12cef1-5d3f-4faa-9772-5956c240f5d8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.827251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.895569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfea2d2-5892-4380-b442-d583a6641123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.896964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea2d2-5892-4380-b442-d583a6641123 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.897248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea2d2-5892-4380-b442-d583a6641123 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.897523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfea2d2-5892-4380-b442-d583a6641123 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.910281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfea2d2-5892-4380-b442-d583a6641123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6bfea2d2-5892-4380-b442-d583a6641123 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:05.918315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:05.919302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:05.920180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:05.920820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 342/696] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:05.933060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfea2d2-5892-4380-b442-d583a6641123 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.939554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27391773-57e3-4eea-b71b-a03a587ab1f8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.977412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.978191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.978466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.978739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.979543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:05.979848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.981333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.995730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 355/697] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:06.002075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.070275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.080859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfea2d2-5892-4380-b442-d583a6641123 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.110871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f828-7571-4101-9e30-73ed97c7f792 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.119311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.120017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.120301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.120584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.121412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:06.121768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.124478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.137822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 343/698] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:06.144679 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.160940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.162435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.162865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.163307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.165030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=7835f273e70a411fa7f8ee57395861f3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:06.165490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.167518 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.176783 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 356/699] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/role_assignments?user.id=7835f273e70a411fa7f8ee57395861f3&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:06.190354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.269128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb5178-3cf8-4a22-b2cf-f7ce570f72b6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.317568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.318546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.318926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.319300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.332185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.333786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:06.353337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:06.354470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:06.355533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:06.355533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:06.355533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:06.355533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:06.357483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 344/700] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:06.363035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.468634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2876916-405c-4152-906d-c08be3f979fc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.495347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.504690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.509920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.509920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.509920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.509920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:06.509920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.509920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.521083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 357/701] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:06.526312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.617379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.637442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638471-e306-4e17-8263-af5927f3d74a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.673748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.674633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.674974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.675314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.683247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.684776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:06.700175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:06.701326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:06.702493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:06.705213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 345/702] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:06.709172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.818721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a4ff0-b223-45db-b4be-f28b962c9aff None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.853508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfac13-8359-4613-9909-f77526c4a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.854179 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfac13-8359-4613-9909-f77526c4a90b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.854459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfac13-8359-4613-9909-f77526c4a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.854722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfac13-8359-4613-9909-f77526c4a90b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.855552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfac13-8359-4613-9909-f77526c4a90b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:06.855856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfac13-8359-4613-9909-f77526c4a90b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.857286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfac13-8359-4613-9909-f77526c4a90b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.879997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 358/703] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:06.881013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.028203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae6081-0056-4a65-a40b-6c07f90097b6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.030179 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae6081-0056-4a65-a40b-6c07f90097b6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.030179 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae6081-0056-4a65-a40b-6c07f90097b6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.030335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 359/704] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:07.035579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780a9da-2961-40ae-a0f7-6581d05bd3f9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.035868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780a9da-2961-40ae-a0f7-6581d05bd3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.036173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780a9da-2961-40ae-a0f7-6581d05bd3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.036729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98ee5-eb5c-4974-9940-5969d6de348d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.053452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0780a9da-2961-40ae-a0f7-6581d05bd3f9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:07.054643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0780a9da-2961-40ae-a0f7-6581d05bd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:07.106409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4831fb1-346c-488a-ba4b-4c6b6f9c548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.107416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4831fb1-346c-488a-ba4b-4c6b6f9c548b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.107929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4831fb1-346c-488a-ba4b-4c6b6f9c548b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.108432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4831fb1-346c-488a-ba4b-4c6b6f9c548b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.131752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.146752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.204466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 360/705] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:23:07.228249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780a9da-2961-40ae-a0f7-6581d05bd3f9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.252918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4831fb1-346c-488a-ba4b-4c6b6f9c548b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.254220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4831fb1-346c-488a-ba4b-4c6b6f9c548b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.350373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780a9da-2961-40ae-a0f7-6581d05bd3f9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.394171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.395371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.395898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.396391 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.397258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.398818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:07.435078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:07.436182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:07.437020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 361/706] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:07.449310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.491226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 346/707] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:23:07.498933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4831fb1-346c-488a-ba4b-4c6b6f9c548b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.538774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.585141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.638394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520d90f-a197-42e5-8a49-e3e78d40139c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.676073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.676876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.677165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.677450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.678186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:07.678499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.679972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.689044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 362/708] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:07.695470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.702483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4831fb1-346c-488a-ba4b-4c6b6f9c548b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.763749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e78b7-2537-4a16-aea1-1c28311ecfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.764599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e78b7-2537-4a16-aea1-1c28311ecfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.764876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e78b7-2537-4a16-aea1-1c28311ecfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.765148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e78b7-2537-4a16-aea1-1c28311ecfd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.776498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e78b7-2537-4a16-aea1-1c28311ecfd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.778438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e78b7-2537-4a16-aea1-1c28311ecfd5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ea6e78b7-2537-4a16-aea1-1c28311ecfd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:07.797770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:07.798680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:07.799568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:07.799568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:07.799568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:07.799568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:07.803503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 347/709] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:07.804981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ebc5-33ec-4513-82e5-a870c5a672e8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.805264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ebc5-33ec-4513-82e5-a870c5a672e8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.805538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ebc5-33ec-4513-82e5-a870c5a672e8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.807132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 348/710] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:07.811800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ebc5-33ec-4513-82e5-a870c5a672e8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.852772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7777f-545a-40f4-a713-623cac778135 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.854573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.902677 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22d5e1-c63d-4895-abb1-e9b1f12f143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.904117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d5e1-c63d-4895-abb1-e9b1f12f143a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.905059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d5e1-c63d-4895-abb1-e9b1f12f143a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.905618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22d5e1-c63d-4895-abb1-e9b1f12f143a None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.906676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22d5e1-c63d-4895-abb1-e9b1f12f143a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:07.907209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22d5e1-c63d-4895-abb1-e9b1f12f143a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.909992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22d5e1-c63d-4895-abb1-e9b1f12f143a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.914623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.927995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ebc5-33ec-4513-82e5-a870c5a672e8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.928485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 363/711] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:07.931137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634794-93df-4c89-8117-ff9a8a586463 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.931617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634794-93df-4c89-8117-ff9a8a586463 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.932138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634794-93df-4c89-8117-ff9a8a586463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.967272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bd634794-93df-4c89-8117-ff9a8a586463 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:07.968878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bd634794-93df-4c89-8117-ff9a8a586463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:08.005092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:08.006056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.006598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.007279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.008893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:08.009404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:08.011018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:08.026110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 349/712] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:08.032395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:08.107870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 364/713] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:08.139189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd634794-93df-4c89-8117-ff9a8a586463 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:08.201885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ce0d1-4191-44e6-bef0-5aaa5a3c945f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:08.238200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:08.238989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.239269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.239547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.246870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:08.248589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:08.257711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:08.264040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd634794-93df-4c89-8117-ff9a8a586463 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:08.265031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:08.266452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:08.267412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:08.267412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:08.267412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:08.267412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:08.267412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:08.267412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:08.267412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:08.267412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:08.269861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 350/714] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:08.275391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:08.301838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:08.307342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:08.309996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.310293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.310578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] PATH_INFO: `/v3/services/network` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.311247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:08.314489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:08.333948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:08.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:08.336239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 365/715] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:08 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:08.343128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:08.478758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7c6b-cbde-4fda-8c62-96a8b4a03fce None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:08.539969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01b75b-dd91-4666-b3ec-46200014bb1e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:08.551368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:08.552145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.552491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.552875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.553674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:08.554024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:08.555460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:08.586417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 351/716] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:08.597236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:08.597902 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.598180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.598452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.599153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] RBAC: Adding query filter params (name=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:08.599456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:08.601501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:08.601750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:08.606854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 366/717] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:08.612834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:08.670973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:08.729953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:08.757924 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb39f4-695c-44d8-bb38-371b14bbc078 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:08.764207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc85ef-6655-4059-8ca0-0411ae019724 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:08.793176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7bf1b-0286-46fa-9a6b-55ca36b0ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:08.793835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7bf1b-0286-46fa-9a6b-55ca36b0ff97 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.794128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7bf1b-0286-46fa-9a6b-55ca36b0ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.794426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7bf1b-0286-46fa-9a6b-55ca36b0ff97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.795194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7bf1b-0286-46fa-9a6b-55ca36b0ff97 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=ad41d031778c4e8ebc8c176c3670f4b2) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:08.795501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7bf1b-0286-46fa-9a6b-55ca36b0ff97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:08.797824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7bf1b-0286-46fa-9a6b-55ca36b0ff97 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:08.802854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:08.803749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.804344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.804816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.805732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] RBAC: Adding query filter params (type=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:08.806240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:08.807829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:08.809522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 352/718] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:08 2022] GET /identity/v3/role_assignments?user.id=ad41d031778c4e8ebc8c176c3670f4b2&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:08.811005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf097333-f783-4392-89d5-eb0b8bf00207 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.811297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf097333-f783-4392-89d5-eb0b8bf00207 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.811576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf097333-f783-4392-89d5-eb0b8bf00207 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.817852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 353/719] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:08.819472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 367/720] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:08.819608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4f6-0aaa-4ea8-9758-4c13b118c9a5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:08.823935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4f6-0aaa-4ea8-9758-4c13b118c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:08.823935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4f6-0aaa-4ea8-9758-4c13b118c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:08.853384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bbe9f4f6-0aaa-4ea8-9758-4c13b118c9a5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:08.854687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bbe9f4f6-0aaa-4ea8-9758-4c13b118c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:08.970354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 354/721] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:09.006185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.101621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5e6b-bc1c-4e82-abc1-8af75816fcbb None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.101972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5e6b-bc1c-4e82-abc1-8af75816fcbb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.102185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb5e6b-bc1c-4e82-abc1-8af75816fcbb None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.103810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 355/722] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:09.110489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1c7f-318c-46d4-b810-040555babf83 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.110777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1c7f-318c-46d4-b810-040555babf83 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.111060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a1c7f-318c-46d4-b810-040555babf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.119088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.133311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f50a1c7f-318c-46d4-b810-040555babf83 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:09.138337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef03e-59b0-49b4-930f-8dfca3090c86 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.138448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f50a1c7f-318c-46d4-b810-040555babf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:09.173040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8bf0a-03f0-4f8c-bba8-96862da76a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.173836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf0a-03f0-4f8c-bba8-96862da76a6a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.174125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf0a-03f0-4f8c-bba8-96862da76a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.174400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8bf0a-03f0-4f8c-bba8-96862da76a6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.185710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8bf0a-03f0-4f8c-bba8-96862da76a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-4ab8bf0a-03f0-4f8c-bba8-96862da76a6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:09.193478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:09.194416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:09.195243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 368/723] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:09.200208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8bf0a-03f0-4f8c-bba8-96862da76a6a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.215198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.224001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 356/724] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:23:09.260960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1c7f-318c-46d4-b810-040555babf83 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.378598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8bf0a-03f0-4f8c-bba8-96862da76a6a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.436034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a1c7f-318c-46d4-b810-040555babf83 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.446701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.447376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.447660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.447955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.448716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:09.449024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:09.450403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:09.465125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 369/725] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:09.471018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.491400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.493196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac45b55-d537-4113-9ba4-cacb349407e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.494459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac45b55-d537-4113-9ba4-cacb349407e4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.494743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac45b55-d537-4113-9ba4-cacb349407e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.495020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac45b55-d537-4113-9ba4-cacb349407e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.517106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac45b55-d537-4113-9ba4-cacb349407e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7ac45b55-d537-4113-9ba4-cacb349407e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:09.526183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:09.527073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:09.528015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:09.532030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 357/726] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:09.534194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac45b55-d537-4113-9ba4-cacb349407e4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.638466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.671672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe1905-27d0-4002-8886-2a7e6ff0449d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.715054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac45b55-d537-4113-9ba4-cacb349407e4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.746656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.747687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.748220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.748678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.761234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:09.762942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:09.783579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:09.784523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:09.785394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:09.785394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:09.785394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:09.785394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:09.787728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 370/727] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:09.793174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.793850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.794133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.794407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.795152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:09.795455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:09.797374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:09.802592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.808428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 358/728] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:09.823006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.896254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.971119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4103-a836-4ef5-b7c1-9b772c6fdb0c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.990074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b45c7-3d14-453a-b2ab-69a70b635c6d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.992850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.009354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.010360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.010794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.011220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.032976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.034703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:10.065325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:10.066498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:10.067610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:10.067610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:10.067610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:10.067610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:10.068767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.069734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.074349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 359/729] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:10.074979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.075526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.076529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:10.077028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.079181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.082567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.094193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 371/730] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:10.105726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.206095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db5810-34ff-4960-bd64-ddedad33b76a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.246389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.247074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.247352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.247623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.248376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:10.248682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.250600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.274722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 360/731] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:10.280934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.309802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dd833-f377-49cf-af09-7d851e8fbe50 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.334334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.340190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.347347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.349937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.349937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.349937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.356953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.358690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:10.393652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:10.395058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:10.396020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:10.398402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 372/732] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:10.410466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.479951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fdc70-fba4-4927-9f3d-7a5cf7471044 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.525604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb04e3e-6b0b-4f4c-ab7e-fadea92e4e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.526418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04e3e-6b0b-4f4c-ab7e-fadea92e4e05 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.526695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04e3e-6b0b-4f4c-ab7e-fadea92e4e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.526968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04e3e-6b0b-4f4c-ab7e-fadea92e4e05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.539171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb04e3e-6b0b-4f4c-ab7e-fadea92e4e05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.548714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb04e3e-6b0b-4f4c-ab7e-fadea92e4e05 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.552568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9490-c6f1-44b0-ae75-45b18e3e5856 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fdb04e3e-6b0b-4f4c-ab7e-fadea92e4e05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:10.567071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:10.568029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:23:10.568965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:10.571657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 361/733] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:10.573108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a37a-7b1b-42be-b7a1-80cafb9b57d9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.573597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a37a-7b1b-42be-b7a1-80cafb9b57d9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.574100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875a37a-7b1b-42be-b7a1-80cafb9b57d9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.575756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 362/734] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:10.581501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2d49c-4f82-416c-804e-0da000041219 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.582070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2d49c-4f82-416c-804e-0da000041219 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.582664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2d49c-4f82-416c-804e-0da000041219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.593555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.594258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.594543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.594826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.595669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:10.596032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.597624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.601264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-68d2d49c-4f82-416c-804e-0da000041219 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:10.602708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-68d2d49c-4f82-416c-804e-0da000041219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:10.615420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 373/735] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:10.616352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.659512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.681978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 363/736] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:10.683503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2d49c-4f82-416c-804e-0da000041219 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.719302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e3be7-f5f8-479c-92ad-97173a973452 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.724836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.761918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.762597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.762876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.763159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.764054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:10.764373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.766359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.788028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 374/737] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:10.788893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.814440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2d49c-4f82-416c-804e-0da000041219 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.852006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777c816-93cf-46a5-904b-b71acc185897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.853025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777c816-93cf-46a5-904b-b71acc185897 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.853607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777c816-93cf-46a5-904b-b71acc185897 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.854182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777c816-93cf-46a5-904b-b71acc185897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.889480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.893671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb293a90-9b73-417b-a9ed-20bbfa5dc5b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.929821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777c816-93cf-46a5-904b-b71acc185897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.930529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28955-bc29-418e-827d-4131fc4cc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.931202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28955-bc29-418e-827d-4131fc4cc6c4 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.931487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28955-bc29-418e-827d-4131fc4cc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.931769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28955-bc29-418e-827d-4131fc4cc6c4 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.932531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28955-bc29-418e-827d-4131fc4cc6c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.932832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777c816-93cf-46a5-904b-b71acc185897 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.933895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28955-bc29-418e-827d-4131fc4cc6c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.959651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.024598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 375/738] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:10 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:11.026227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28955-bc29-418e-827d-4131fc4cc6c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.063028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 364/739] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:23:11.068664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777c816-93cf-46a5-904b-b71acc185897 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.183388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28955-bc29-418e-827d-4131fc4cc6c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.273995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411518-f41a-446e-8215-0abc78b529e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.275297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411518-f41a-446e-8215-0abc78b529e6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.275823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411518-f41a-446e-8215-0abc78b529e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.276590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411518-f41a-446e-8215-0abc78b529e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.279247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777c816-93cf-46a5-904b-b71acc185897 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.311573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.313705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.325770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7f885-7e9b-43d7-aa81-07144bb145b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.326794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f885-7e9b-43d7-aa81-07144bb145b5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.341326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f885-7e9b-43d7-aa81-07144bb145b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.341326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f885-7e9b-43d7-aa81-07144bb145b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.341326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7f885-7e9b-43d7-aa81-07144bb145b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.342676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7f885-7e9b-43d7-aa81-07144bb145b5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5ba7f885-7e9b-43d7-aa81-07144bb145b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:11.364658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:11.365749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:11.366918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:11.366918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:11.366918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:11.366918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:11.367189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411518-f41a-446e-8215-0abc78b529e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.367276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 365/740] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:11.367357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f411518-f41a-446e-8215-0abc78b529e6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.367446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822168f-c055-4ca4-b72a-0ca1ddb10feb None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.367706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822168f-c055-4ca4-b72a-0ca1ddb10feb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.371948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822168f-c055-4ca4-b72a-0ca1ddb10feb None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.371948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 366/741] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:11.371948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c0127-9c3b-41c0-aacf-85ae9ea684a6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.371948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c0127-9c3b-41c0-aacf-85ae9ea684a6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.371948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c0127-9c3b-41c0-aacf-85ae9ea684a6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.373115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 367/742] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:11.376815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c0127-9c3b-41c0-aacf-85ae9ea684a6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.477995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 376/743] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:23:11.479196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3b18-b68d-4e11-9dd4-f34935cb0083 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.479480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3b18-b68d-4e11-9dd4-f34935cb0083 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.479757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf3b18-b68d-4e11-9dd4-f34935cb0083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.489635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c0127-9c3b-41c0-aacf-85ae9ea684a6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.496335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cccf3b18-b68d-4e11-9dd4-f34935cb0083 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:11.497775 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cccf3b18-b68d-4e11-9dd4-f34935cb0083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:11.527631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5827-ff5d-4667-90e1-fcc6bfe9d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.528323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5827-ff5d-4667-90e1-fcc6bfe9d87a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.528604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5827-ff5d-4667-90e1-fcc6bfe9d87a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.528884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5827-ff5d-4667-90e1-fcc6bfe9d87a None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.529629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b5827-ff5d-4667-90e1-fcc6bfe9d87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:11.529934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b5827-ff5d-4667-90e1-fcc6bfe9d87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.531830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b5827-ff5d-4667-90e1-fcc6bfe9d87a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.544031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 368/744] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:11.544502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cb60-53b9-4372-8f0a-07ba6bdb2f08 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.544795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cb60-53b9-4372-8f0a-07ba6bdb2f08 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.545070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cb60-53b9-4372-8f0a-07ba6bdb2f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.555702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.561911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2172cb60-53b9-4372-8f0a-07ba6bdb2f08 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:11.563126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2172cb60-53b9-4372-8f0a-07ba6bdb2f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:11.573805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 377/745] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:11.574682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf3b18-b68d-4e11-9dd4-f34935cb0083 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.602776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.644154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 369/746] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:23:11.645021 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172cb60-53b9-4372-8f0a-07ba6bdb2f08 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.692812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf3b18-b68d-4e11-9dd4-f34935cb0083 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.735984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.736759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.737039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.737621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.747826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.748523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172cb60-53b9-4372-8f0a-07ba6bdb2f08 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.749302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:11.768543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:11.769448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:11.770298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:11.770298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:11.770298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:11.770298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:11.770298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 378/747] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:11.770572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.785279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.786073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.786356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.786634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.793653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.795085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:11.809160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:11.810115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:11.811018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 370/748] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:11.811508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.813552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.843487 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.881766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c72c-d595-42c6-9660-1b32644f0028 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.917265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd3be1-44b2-4fb8-9881-9b1e1a51fbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.918145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd3be1-44b2-4fb8-9881-9b1e1a51fbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.918318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd3be1-44b2-4fb8-9881-9b1e1a51fbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.918593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd3be1-44b2-4fb8-9881-9b1e1a51fbb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.922736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8a47-abfa-4d1c-8c72-d8a1e7a8d59e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.929545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd3be1-44b2-4fb8-9881-9b1e1a51fbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bbcd3be1-44b2-4fb8-9881-9b1e1a51fbb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:11.937057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:11.938528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:11.939349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 379/749] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:11.940073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd3be1-44b2-4fb8-9881-9b1e1a51fbb1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.964318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340668c-7bfa-490f-aee3-eccc130667e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.964987 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340668c-7bfa-490f-aee3-eccc130667e1 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.965269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340668c-7bfa-490f-aee3-eccc130667e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.965542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340668c-7bfa-490f-aee3-eccc130667e1 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.966264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340668c-7bfa-490f-aee3-eccc130667e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.967623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340668c-7bfa-490f-aee3-eccc130667e1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.038230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 371/750] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:11 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:12.040221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:12.045383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340668c-7bfa-490f-aee3-eccc130667e1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.046934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd3be1-44b2-4fb8-9881-9b1e1a51fbb1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.094932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.095686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.096000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.096276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.097024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:12.097333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.099601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.114130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 380/751] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:12.115083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.173643 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:12.197362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340668c-7bfa-490f-aee3-eccc130667e1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.238132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60818b0d-c6a5-4306-afbd-bd13cc4ff2f2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.243266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.244747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.244747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.244747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.245264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:12.245571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.246995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.263151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 372/752] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:12.263990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.293503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.294347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.295050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.295329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.296418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:12.296726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.299015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.309933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 381/753] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:12.310768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.344697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:12.385345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d973bcd-4ecc-4c7a-833a-061bd068a58c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.427092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.427890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.428201 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.428475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.436093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d729e5-ab9b-4dc9-8167-46c7d3ae5ded None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.440516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.442019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:12.459660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:12.460601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:12.461491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:12.461491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:12.461491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:12.461491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:12.461491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:12.461491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:12.461491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:12.461491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:12.463983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 373/754] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:12.464981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.481817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.483202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.483680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.484839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.486283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=21cd048d475f481393fd7749e4335c6a) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:12.487064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.489134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.496390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:12.496599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 382/755] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/role_assignments?user.id=21cd048d475f481393fd7749e4335c6a&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:12.497509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.600452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:12.617670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5bdcf-2d3a-43d1-9614-e44923473bc9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.668175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde690ba-cea1-4fc3-8787-333c6cb4eb94 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.673553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.674229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.674508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.674784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.675582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:12.675893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.681570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.711177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 383/756] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:12.712999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.731135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.731993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.732283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.738405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.753816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.756108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:12.781453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:12.782508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:12.783465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:12.783465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:12.783465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:12.783465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:12.786340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 374/757] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:12.792030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.854393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:12.881296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82fa86-53a0-465e-b852-bbd2aaf94499 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.901189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4612fd3-becf-4d85-be80-8b2cbe417cf7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.937241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.937907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.938189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.938461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.939175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:12.939476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.940851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.949282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.949963 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.950248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.950523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.951365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=7835f273e70a411fa7f8ee57395861f3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:12.951679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.953191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.953829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 375/758] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:12.959262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.966664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 384/759] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/role_assignments?user.id=7835f273e70a411fa7f8ee57395861f3&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:13.075215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf8e0-dd58-4c60-acd4-9aed7dd0916e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.095550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:13.126414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.127149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.127432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.127706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.141180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:13.142638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:13.164041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:13.165262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:13.166431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 376/760] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:13.173483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.176455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:13.332236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39858a34-e64a-458f-9eab-6f46efbc5b03 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.383090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928282-9a53-4dfc-9997-7c14e43a2108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.383955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928282-9a53-4dfc-9997-7c14e43a2108 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.384239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928282-9a53-4dfc-9997-7c14e43a2108 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.384512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928282-9a53-4dfc-9997-7c14e43a2108 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.385354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928282-9a53-4dfc-9997-7c14e43a2108 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:13.385658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928282-9a53-4dfc-9997-7c14e43a2108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:13.387099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928282-9a53-4dfc-9997-7c14e43a2108 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:13.413646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 385/761] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:13.419108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.524820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c434c2-7f92-4d09-923f-60dddaf43b60 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.525346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c434c2-7f92-4d09-923f-60dddaf43b60 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.525486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c434c2-7f92-4d09-923f-60dddaf43b60 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.530452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 386/762] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:13.531823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3457fd-ede7-4dcc-a72f-8ce246a2bf86 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.532130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3457fd-ede7-4dcc-a72f-8ce246a2bf86 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.532405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3457fd-ede7-4dcc-a72f-8ce246a2bf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.563131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36db2-228a-4c2b-83b0-633e4a63cb09 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.564906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6d3457fd-ede7-4dcc-a72f-8ce246a2bf86 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:13.566092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6d3457fd-ede7-4dcc-a72f-8ce246a2bf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:13.618913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.620018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.620479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.620953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.642915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:13.644646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:13.668873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:13.669806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:13.670683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:13.670683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:13.670683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:13.670683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:13.678780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 377/763] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:13.678919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:13.685274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.687575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 387/764] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:13.729417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:13.756556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3457fd-ede7-4dcc-a72f-8ce246a2bf86 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.856019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882c2c3-72e2-4a59-9f91-24fa0d069ff2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.927596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.928217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.928496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.928768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.929501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:13.929807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:13.931174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:13.944821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3457fd-ede7-4dcc-a72f-8ce246a2bf86 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.958967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 378/765] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:13.962456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.015469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.016663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.017150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.017602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.018436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:14.020067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:14.044301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:14.045308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:14.046143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:14.049552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 388/766] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jun 15 00:23:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:14.055479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.072285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:14.080558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb93bdb-2b47-4d46-aa5b-d2aa552aaced None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:14.117322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.118435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.118721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.118999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.127608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:14.129258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:14.145120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:14.146026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:14.146890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:14.146890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:14.146890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:14.146890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:14.146890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:14.146890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:14.146890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:14.146890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:14.147311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 379/767] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:14.152792 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.175452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:14.260128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d61c6-1910-40b0-b4ab-48e61bd8b2e0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:14.296206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.297390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.297671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.298000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.298922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:14.299277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:14.300896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:14.314511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 380/768] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:14.320403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.325647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090f808-9b2a-427b-839d-bc13b5136524 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:14.334893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:14.435845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.437704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.437994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.438274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.439006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:14.439314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:14.440757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:14.450863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690d88e-15bf-4dca-9a45-bca769e5cb84 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:14.460270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 389/769] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:14.476141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.503888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc7664-4f1e-4b69-8ef9-4a90c7f20279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.504795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7664-4f1e-4b69-8ef9-4a90c7f20279 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.505075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7664-4f1e-4b69-8ef9-4a90c7f20279 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.505348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7664-4f1e-4b69-8ef9-4a90c7f20279 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/ad41d031778c4e8ebc8c176c3670f4b2/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.507295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc7664-4f1e-4b69-8ef9-4a90c7f20279 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=ad41d031778c4e8ebc8c176c3670f4b2, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:14.509001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc7664-4f1e-4b69-8ef9-4a90c7f20279 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:14.590928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90040eab-6f0b-45d1-ae0f-1b9a87ddaf96 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:14.591735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 381/770] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:14 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/ad41d031778c4e8ebc8c176c3670f4b2/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:23:14.593972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b239b-6750-48ae-9376-53c9f2776240 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.594462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b239b-6750-48ae-9376-53c9f2776240 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.594968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b239b-6750-48ae-9376-53c9f2776240 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.604384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 382/771] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:14.610777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3037e-c312-4df9-9d7c-a967d085bab8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.611300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3037e-c312-4df9-9d7c-a967d085bab8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.611807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3037e-c312-4df9-9d7c-a967d085bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.616077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:14.634280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.634965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.635224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.635497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.636388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:14.636693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:14.643932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:14.645479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 390/772] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:14.651418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.657265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f3b3037e-c312-4df9-9d7c-a967d085bab8 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:14.658748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f3b3037e-c312-4df9-9d7c-a967d085bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:14.775397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69aaf8-176e-45d6-9879-5a1d3bc007d4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:14.814698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.815673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.816318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.817004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.817976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] RBAC: Adding query filter params (interface=public, service_id=ca7e3b30340b4b79a09ceef2b44588a6, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:14.818793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:14.820904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:14.831846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 391/773] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/endpoints?service_id=ca7e3b30340b4b79a09ceef2b44588a6&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:14.838078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.854497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:14.861220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 383/774] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 15 00:23:14.885288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3037e-c312-4df9-9d7c-a967d085bab8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.918503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:14.963243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dd94c-2608-4d2b-9a5b-4cae18dc3058 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.000342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25de6-1170-4829-b762-07a6e5677039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.001109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25de6-1170-4829-b762-07a6e5677039 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.001462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25de6-1170-4829-b762-07a6e5677039 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.001833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25de6-1170-4829-b762-07a6e5677039 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.002592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed25de6-1170-4829-b762-07a6e5677039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.004148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed25de6-1170-4829-b762-07a6e5677039 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.010163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 392/775] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:15.018540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3037e-c312-4df9-9d7c-a967d085bab8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.064004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bcf78-f323-406e-83b3-e7f0499fe877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.065124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bcf78-f323-406e-83b3-e7f0499fe877 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.065583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bcf78-f323-406e-83b3-e7f0499fe877 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.066032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bcf78-f323-406e-83b3-e7f0499fe877 None admin] PATH_INFO: `/v3/services/network` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.066888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bcf78-f323-406e-83b3-e7f0499fe877 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.068511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bcf78-f323-406e-83b3-e7f0499fe877 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-485bcf78-f323-406e-83b3-e7f0499fe877 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:15.086781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:15.087831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:15.093766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:15.096486 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 384/776] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:15.105225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25de6-1170-4829-b762-07a6e5677039 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.151733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ad4c-6846-41b2-b2e8-2124675dad96 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.152271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ad4c-6846-41b2-b2e8-2124675dad96 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.153356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ad4c-6846-41b2-b2e8-2124675dad96 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.155435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 385/777] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:15.161530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35140d-aa8c-43bc-9603-59f797b4dab1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.161853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35140d-aa8c-43bc-9603-59f797b4dab1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.162089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35140d-aa8c-43bc-9603-59f797b4dab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.197760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1c35140d-aa8c-43bc-9603-59f797b4dab1 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:15.198999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1c35140d-aa8c-43bc-9603-59f797b4dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:15.289295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25de6-1170-4829-b762-07a6e5677039 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.291317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.303882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 386/778] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:15.310520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.326919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35140d-aa8c-43bc-9603-59f797b4dab1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.347761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.348487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.348764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.349034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.349806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] RBAC: Adding query filter params (name=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:15.350113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.352364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.360930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 393/779] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:15.367449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.460456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35140d-aa8c-43bc-9603-59f797b4dab1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.508872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb1287-d24a-48fc-a474-ff98420c1f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.509670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1287-d24a-48fc-a474-ff98420c1f25 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.509950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1287-d24a-48fc-a474-ff98420c1f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.510365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb1287-d24a-48fc-a474-ff98420c1f25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.514237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545284a1-1504-447b-a98a-94fe08d145bc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.521277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb1287-d24a-48fc-a474-ff98420c1f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6ceb1287-d24a-48fc-a474-ff98420c1f25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:15.529827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:15.531444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:15.532312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 387/780] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:15.532991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11eb84-ce6c-4f33-9e44-ad9b61d67647 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.533565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11eb84-ce6c-4f33-9e44-ad9b61d67647 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.533565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11eb84-ce6c-4f33-9e44-ad9b61d67647 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.534924 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 388/781] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:15.539598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11eb84-ce6c-4f33-9e44-ad9b61d67647 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.555158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7107e28-9323-4a3f-9764-e3e8775c63f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.556239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107e28-9323-4a3f-9764-e3e8775c63f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.556725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107e28-9323-4a3f-9764-e3e8775c63f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.557199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7107e28-9323-4a3f-9764-e3e8775c63f2 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.558108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7107e28-9323-4a3f-9764-e3e8775c63f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:15.558615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7107e28-9323-4a3f-9764-e3e8775c63f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.560245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7107e28-9323-4a3f-9764-e3e8775c63f2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.565938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 394/782] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:15.571803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab63a2d-4add-4b00-b884-fee24bf78b1e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.572403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab63a2d-4add-4b00-b884-fee24bf78b1e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.572889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab63a2d-4add-4b00-b884-fee24bf78b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.590957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6ab63a2d-4add-4b00-b884-fee24bf78b1e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:15.593143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6ab63a2d-4add-4b00-b884-fee24bf78b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:15.596797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.627933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.650574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11eb84-ce6c-4f33-9e44-ad9b61d67647 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.670236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 395/783] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:15.672055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab63a2d-4add-4b00-b884-fee24bf78b1e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.703253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.704044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.704326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.704596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.705459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:15.705767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.707122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.725799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 389/784] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:15.725799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.793704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab63a2d-4add-4b00-b884-fee24bf78b1e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.831229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.832306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.832770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.833323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.834284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] RBAC: Adding query filter params (interface=public, service_id=0d62763270ad45b8a8c9c5ba3fea11a1, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:15.834785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.836571 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.847290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 396/785] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/endpoints?service_id=0d62763270ad45b8a8c9c5ba3fea11a1&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:15.848559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.854731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ea96-8eda-41f6-9a16-8ae862c202b0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.873315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.886824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.898747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6b99a-f1d2-4c75-994d-d6e4356c5ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.899536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6b99a-f1d2-4c75-994d-d6e4356c5ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.899816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6b99a-f1d2-4c75-994d-d6e4356c5ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.900168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6b99a-f1d2-4c75-994d-d6e4356c5ba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.912589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6b99a-f1d2-4c75-994d-d6e4356c5ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b0d6b99a-f1d2-4c75-994d-d6e4356c5ba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:15.919930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:15.920839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:15.922349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:15.927238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 390/786] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:15.928114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6b99a-f1d2-4c75-994d-d6e4356c5ba0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.972604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc640-47fb-43ed-a5d8-a46a275f701f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.020712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf16ca-c454-433d-947e-866202801455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.021999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf16ca-c454-433d-947e-866202801455 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.022759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf16ca-c454-433d-947e-866202801455 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.023197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf16ca-c454-433d-947e-866202801455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.038271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf16ca-c454-433d-947e-866202801455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.039737 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf16ca-c454-433d-947e-866202801455 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.043507 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6b99a-f1d2-4c75-994d-d6e4356c5ba0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-90bf16ca-c454-433d-947e-866202801455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:16.065079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:16.065995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:16.066882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:16.066882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:16.066882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:16.066882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:16.067537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 397/787] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:16.069034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf16ca-c454-433d-947e-866202801455 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.087989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6292b0-4c7b-47c6-8886-038a42925b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.089448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6292b0-4c7b-47c6-8886-038a42925b59 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.090186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6292b0-4c7b-47c6-8886-038a42925b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.090648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6292b0-4c7b-47c6-8886-038a42925b59 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.091764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6292b0-4c7b-47c6-8886-038a42925b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.093770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6292b0-4c7b-47c6-8886-038a42925b59 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.102064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 391/788] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:16.103117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6292b0-4c7b-47c6-8886-038a42925b59 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.189667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.209449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf16ca-c454-433d-947e-866202801455 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.221118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.260800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.261481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.261761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.262033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.262801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:16.263106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.264543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.274448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 398/789] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:16.280164 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.345030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6292b0-4c7b-47c6-8886-038a42925b59 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.396545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.397854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.398789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.399558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.400778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:16.401314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.403606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.404993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43df8b-3a2d-4409-8f5e-bb9f7d1222ce None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.420405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 392/790] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:16.426257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.454758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.455968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.456461 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.456937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.472125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.474639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.483327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:16.494946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:16.499638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:16.500561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:16.500561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:16.500561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:16.500561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:16.500561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 399/791] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:16.504113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.620659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719babe-dca8-4481-a770-95f91c499fe9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.661944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.662968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.663481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.664018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.665391 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:16.665908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.667478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.671985 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.682858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 400/792] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:16.687950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111de22-de39-4aac-9f75-a6fc0e8d2c75 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.692999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.764315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.802979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.803868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.804182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.804465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.807822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1535-977d-4ffb-9b84-2d69da4a25cf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.819654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.821148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.845614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.846433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.846717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.846989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:16.851677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:16.852612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:16.853531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:16.854498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.855825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.860346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 393/793] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:16.861253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:16.871101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:16.873243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:16.880021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 401/794] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:16.888917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.985385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633ca0d-10a2-4fdc-af15-4ef9d8703514 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.030347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.030347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.030347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.030347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.031138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:17.031138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.031138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.070237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 394/795] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:17.076828 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbcc3c-2b21-4ede-8aaf-a0a7d3f1d472 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.078496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.112134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.120312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.138504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e3f03-d336-4f48-9601-dbe871921ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.140085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3f03-d336-4f48-9601-dbe871921ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.140581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3f03-d336-4f48-9601-dbe871921ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.141404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3f03-d336-4f48-9601-dbe871921ca5 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.142754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e3f03-d336-4f48-9601-dbe871921ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:17.143554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e3f03-d336-4f48-9601-dbe871921ca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.145978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e3f03-d336-4f48-9601-dbe871921ca5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.169308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 402/796] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:17.170951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300dcf-8773-4938-a764-cc5db0b5811b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.171987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300dcf-8773-4938-a764-cc5db0b5811b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.172460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1300dcf-8773-4938-a764-cc5db0b5811b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.178714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 403/797] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:17.180238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1300dcf-8773-4938-a764-cc5db0b5811b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.202536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe789a3-14a6-47fa-a001-e595a54c4f01 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.237976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ffa0c-cfca-46a0-b7ec-d6b77f62222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.238832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffa0c-cfca-46a0-b7ec-d6b77f62222f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.239116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffa0c-cfca-46a0-b7ec-d6b77f62222f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.239391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffa0c-cfca-46a0-b7ec-d6b77f62222f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.251004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ffa0c-cfca-46a0-b7ec-d6b77f62222f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.252548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ffa0c-cfca-46a0-b7ec-d6b77f62222f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0a9ffa0c-cfca-46a0-b7ec-d6b77f62222f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:17.271282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:17.272242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:17.273137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:17.273137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:17.273137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:17.273137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:17.273137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 395/798] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:17.274104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715f53-8e25-4735-9de5-1525fc42015d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.274395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715f53-8e25-4735-9de5-1525fc42015d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.274667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715f53-8e25-4735-9de5-1525fc42015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.291055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cd715f53-8e25-4735-9de5-1525fc42015d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:17.292296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cd715f53-8e25-4735-9de5-1525fc42015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:17.316353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1300dcf-8773-4938-a764-cc5db0b5811b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.352482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.353270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.353551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.353825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.365879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.368936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.370431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.375410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 396/799] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:17.379534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715f53-8e25-4735-9de5-1525fc42015d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:17.393208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:17.394254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:17.395163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:17.395163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:17.395163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:17.395163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:17.399425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 404/800] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:17.401016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.437917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.493376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715f53-8e25-4735-9de5-1525fc42015d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.517366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacf3cc-1f65-4848-b5ea-7f2416f2f09e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.528566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.529220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.529501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.529771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.530479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:17.531314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.532695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.548999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 397/801] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:17.548999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.557419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4d281-c67a-4867-88f0-9cba80337cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.558079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4d281-c67a-4867-88f0-9cba80337cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.558361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4d281-c67a-4867-88f0-9cba80337cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.558633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4d281-c67a-4867-88f0-9cba80337cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.559408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4d281-c67a-4867-88f0-9cba80337cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:17.559719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4d281-c67a-4867-88f0-9cba80337cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.561103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4d281-c67a-4867-88f0-9cba80337cb3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.572673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 405/802] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:17.578186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898625d-0579-4c66-86a2-01ddc6a0a5a5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.578789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898625d-0579-4c66-86a2-01ddc6a0a5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.579245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898625d-0579-4c66-86a2-01ddc6a0a5a5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.583716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 406/803] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:17.583716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898625d-0579-4c66-86a2-01ddc6a0a5a5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.612203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.657134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27318-d828-42b7-929d-12bfd18f33fe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.683549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.694849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23813b-e154-4eaf-931b-0d99a4fbfab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.695637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23813b-e154-4eaf-931b-0d99a4fbfab2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.695934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23813b-e154-4eaf-931b-0d99a4fbfab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.696211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23813b-e154-4eaf-931b-0d99a4fbfab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.697015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898625d-0579-4c66-86a2-01ddc6a0a5a5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.707386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23813b-e154-4eaf-931b-0d99a4fbfab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1c23813b-e154-4eaf-931b-0d99a4fbfab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:17.714966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:17.716179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:17.717064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 398/804] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:17.717784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23813b-e154-4eaf-931b-0d99a4fbfab2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.736581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28abe8-4cc7-49bc-bbf5-e09ade2312b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.737750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28abe8-4cc7-49bc-bbf5-e09ade2312b3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.738178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28abe8-4cc7-49bc-bbf5-e09ade2312b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.738604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28abe8-4cc7-49bc-bbf5-e09ade2312b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.745661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28abe8-4cc7-49bc-bbf5-e09ade2312b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.747212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28abe8-4cc7-49bc-bbf5-e09ade2312b3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ee28abe8-4cc7-49bc-bbf5-e09ade2312b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:17.760998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:17.761878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:17.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:17.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:17.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:17.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:17.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:17.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:17.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:17.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:17.767397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 407/805] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:17.768673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34fa22-3acc-4487-99a0-db19decfed0b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.768963 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34fa22-3acc-4487-99a0-db19decfed0b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.769240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34fa22-3acc-4487-99a0-db19decfed0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.786375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dc34fa22-3acc-4487-99a0-db19decfed0b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:17.787689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dc34fa22-3acc-4487-99a0-db19decfed0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:17.837834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23813b-e154-4eaf-931b-0d99a4fbfab2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.855698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 408/806] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:17.856727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34fa22-3acc-4487-99a0-db19decfed0b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.868169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.890864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.891750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.892127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.892464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.899140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.900652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:17.916296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:17.917348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:17.918353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 399/807] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:17.918840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.941178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.961373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34fa22-3acc-4487-99a0-db19decfed0b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.996239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.996890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.997168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.997437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.998172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:17.998472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.000454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.013258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 409/808] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:18.013895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.026975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49873e48-171a-4640-beaa-db365cc852bc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.062903 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.063559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.063839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.064149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.064924 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:18.065235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.066652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.078491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 400/809] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:18.079362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.121752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52096967-efcd-4703-922d-e11b5e5868b6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.124825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:18.158949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.159754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.160078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.160373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.161003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.162364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:18.175341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:18.176358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:18.177163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 410/810] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jun 15 00:23:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:18.178612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.182075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:18.194815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f661f16-102b-4653-ab5a-8e2d9b913998 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.231095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.231754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.232063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.232338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.233112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:18.233418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.235429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.254767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 401/811] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:18.254767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.293852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ef750-66f1-444c-b55e-242e895cb36b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.331077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.331860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.332210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.332501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.344168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.345637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.353165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:18.357559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88f62-321a-4b45-a980-ac776bedd1aa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:18.363752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:18.370058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:18.370948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:18.370948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:18.370948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:18.370948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:18.370948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 411/812] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:18.370948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.400864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415a96-ef81-4bbc-8185-8dfeb3841a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.401670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415a96-ef81-4bbc-8185-8dfeb3841a41 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.401951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415a96-ef81-4bbc-8185-8dfeb3841a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.402894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415a96-ef81-4bbc-8185-8dfeb3841a41 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/21cd048d475f481393fd7749e4335c6a/roles/027b6713998845388cfa9f77e136eb9e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.416794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd415a96-ef81-4bbc-8185-8dfeb3841a41 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=21cd048d475f481393fd7749e4335c6a, role_id=027b6713998845388cfa9f77e136eb9e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.418227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd415a96-ef81-4bbc-8185-8dfeb3841a41 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.426293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:18.469476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4431e4-4f9c-42f2-8fe9-ccba79b4317d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.494916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 402/813] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:18 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/21cd048d475f481393fd7749e4335c6a/roles/027b6713998845388cfa9f77e136eb9e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:23:18.502114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.502800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.503086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.503362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.504122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:18.504473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.505210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415a96-ef81-4bbc-8185-8dfeb3841a41 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.505813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.524969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 412/814] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jun 15 00:23:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:18.526243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.648672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415a96-ef81-4bbc-8185-8dfeb3841a41 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.660748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffebcf1-5198-4f86-87b3-a96201311bd4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.687992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:18.701913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c91ed9-e4eb-45ba-b221-5946f5892379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.702843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91ed9-e4eb-45ba-b221-5946f5892379 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.710948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91ed9-e4eb-45ba-b221-5946f5892379 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.710948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c91ed9-e4eb-45ba-b221-5946f5892379 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/7835f273e70a411fa7f8ee57395861f3/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.710948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c91ed9-e4eb-45ba-b221-5946f5892379 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=7835f273e70a411fa7f8ee57395861f3, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.711195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.711195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.711353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c91ed9-e4eb-45ba-b221-5946f5892379 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.711421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.711421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.711421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:18.711421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:18.711421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:18.723964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 413/815] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:18.723964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.791103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 403/816] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:18 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/7835f273e70a411fa7f8ee57395861f3/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:23:18.792805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dcf2-8abc-4884-8e26-2b53355fc472 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.793256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dcf2-8abc-4884-8e26-2b53355fc472 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.793702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dcf2-8abc-4884-8e26-2b53355fc472 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.795657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 404/817] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:18.797350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295dcf2-8abc-4884-8e26-2b53355fc472 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:18.822151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:18.937422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295dcf2-8abc-4884-8e26-2b53355fc472 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.955699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c99d0-cdd6-4a9e-9b89-03be23f348f7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:18.987161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.988120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.988659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.988939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.997027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef3484-0914-4b8b-a2b0-3ca2b475bbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:18.997698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3484-0914-4b8b-a2b0-3ca2b475bbfa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:18.997976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3484-0914-4b8b-a2b0-3ca2b475bbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:18.998250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef3484-0914-4b8b-a2b0-3ca2b475bbfa None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:18.998957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef3484-0914-4b8b-a2b0-3ca2b475bbfa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:18.999789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef3484-0914-4b8b-a2b0-3ca2b475bbfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.004546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef3484-0914-4b8b-a2b0-3ca2b475bbfa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.004694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.004694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.011093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 414/818] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jun 15 00:23:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:19.012585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac815-e712-442f-8b79-34f1dba48695 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.012871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac815-e712-442f-8b79-34f1dba48695 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.013145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ac815-e712-442f-8b79-34f1dba48695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:19.022846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:19.030344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 405/819] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:19.031538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.036493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d44ac815-e712-442f-8b79-34f1dba48695 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:19.037745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d44ac815-e712-442f-8b79-34f1dba48695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:19.094648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:19.112512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:19.125114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 415/820] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:19.126722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ac815-e712-442f-8b79-34f1dba48695 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.150884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf870d4-2b3c-4238-84c0-8634c73784e8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.189018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d02bb6-4f82-4cde-96d1-7f12c17f63bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.189700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d02bb6-4f82-4cde-96d1-7f12c17f63bc None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.190068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d02bb6-4f82-4cde-96d1-7f12c17f63bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.190410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d02bb6-4f82-4cde-96d1-7f12c17f63bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.191222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d02bb6-4f82-4cde-96d1-7f12c17f63bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.193062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d02bb6-4f82-4cde-96d1-7f12c17f63bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.246650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ac815-e712-442f-8b79-34f1dba48695 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.281961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.282644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.282911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.283186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.284051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:19.284367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.285900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.293751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 406/821] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:19.300287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d02bb6-4f82-4cde-96d1-7f12c17f63bc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.320415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 416/822] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:19.326379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.385642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:19.480281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d02bb6-4f82-4cde-96d1-7f12c17f63bc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.522433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9e98-5c61-465a-9ede-915fd0ea4775 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.531835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.532692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.532979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.533258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] PATH_INFO: `/v3/services/network` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.533921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.536240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:19.552044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:19.553063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:23:19.553902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:19.554633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 407/823] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:19 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:19.554633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:19.560607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.563586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561943-3a19-49f7-ad41-97cefae4bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.565497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561943-3a19-49f7-ad41-97cefae4bbdf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.565497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561943-3a19-49f7-ad41-97cefae4bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.565497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561943-3a19-49f7-ad41-97cefae4bbdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.639369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561943-3a19-49f7-ad41-97cefae4bbdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.641732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561943-3a19-49f7-ad41-97cefae4bbdf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.672270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:19.673686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f472-bf0a-4176-be21-bc6dd62cb93d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.709843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.710464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.710754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.711035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.711796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] RBAC: Adding query filter params (name=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:19.712138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.713525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.723933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 408/824] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:19.724891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.768052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 417/825] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:23:19.774420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561943-3a19-49f7-ad41-97cefae4bbdf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.816316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:19.851187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1efd1-fc86-4152-bb05-d53a7cf4f466 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.910737 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561943-3a19-49f7-ad41-97cefae4bbdf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.925056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.925852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.926144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.926426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.927144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] RBAC: Adding query filter params (type=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:19.927455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.928868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.943282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:19.945232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 409/826] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:19.949476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.950532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.950921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.951298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.951763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.972360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.975582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:19.997971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:19.998870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:20.000389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:20.000389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:20.000389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:20.000389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:20.003145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 418/827] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:20.008218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:20.115226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318482-0204-44c3-aca0-926e1d3f6270 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:20.130167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:20.155587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f30fc1-f436-428c-89f3-bc4d3a2e4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:20.157428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f30fc1-f436-428c-89f3-bc4d3a2e4295 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:20.157936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f30fc1-f436-428c-89f3-bc4d3a2e4295 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:20.162957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f30fc1-f436-428c-89f3-bc4d3a2e4295 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:20.163978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f30fc1-f436-428c-89f3-bc4d3a2e4295 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:20.165632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f30fc1-f436-428c-89f3-bc4d3a2e4295 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:20.200449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6a896-7bd0-481b-84c5-f923edc17ec4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:20.234802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:20.235855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:20.236295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:20.236745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:20.237607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:20.238074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:20.239608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:20.255695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 410/828] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:23:20.260279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 419/829] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:20.269669 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f30fc1-f436-428c-89f3-bc4d3a2e4295 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:20.441898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f30fc1-f436-428c-89f3-bc4d3a2e4295 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:20.477515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:20.478305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:20.478586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:20.478860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:20.486871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:20.488411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:20.502923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:20.503821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:20.504756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 411/830] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:20.510462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:20.558977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:20.614363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c779-855d-4284-88a2-366e9abd62a6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:20.650411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b809917-ad5d-46aa-90ed-e3f42a2c011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:20.651072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809917-ad5d-46aa-90ed-e3f42a2c011c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:20.651351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809917-ad5d-46aa-90ed-e3f42a2c011c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:20.651622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809917-ad5d-46aa-90ed-e3f42a2c011c None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:20.652436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b809917-ad5d-46aa-90ed-e3f42a2c011c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:20.652744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b809917-ad5d-46aa-90ed-e3f42a2c011c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:20.654145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b809917-ad5d-46aa-90ed-e3f42a2c011c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:20.666661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 420/831] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:20.672600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:20.701028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:20.777297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199ab47-bf4f-4166-8d39-d834fa7a157e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:20.813524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ff5bd-c9d4-4e10-8bd0-fadb64dc4579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:20.814180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ff5bd-c9d4-4e10-8bd0-fadb64dc4579 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:20.814462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ff5bd-c9d4-4e10-8bd0-fadb64dc4579 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:20.814736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ff5bd-c9d4-4e10-8bd0-fadb64dc4579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:20.815564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ff5bd-c9d4-4e10-8bd0-fadb64dc4579 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=ad41d031778c4e8ebc8c176c3670f4b2) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:20.815875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ff5bd-c9d4-4e10-8bd0-fadb64dc4579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:20.817341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ff5bd-c9d4-4e10-8bd0-fadb64dc4579 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:20.823862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 412/832] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:20 2022] GET /identity/v3/role_assignments?user.id=ad41d031778c4e8ebc8c176c3670f4b2&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:20.971144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5d29-f545-488a-833a-bf5db7472593 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:20.971688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5d29-f545-488a-833a-bf5db7472593 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:20.971688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5d29-f545-488a-833a-bf5db7472593 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:20.973502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 421/833] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:20.979234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ab91-a175-4011-a289-248a18d9f29e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:20.979521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ab91-a175-4011-a289-248a18d9f29e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:20.979798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3ab91-a175-4011-a289-248a18d9f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:20.997762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f9f3ab91-a175-4011-a289-248a18d9f29e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:20.998961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f9f3ab91-a175-4011-a289-248a18d9f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:21.072043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 413/834] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:21.097749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5d29-f545-488a-833a-bf5db7472593 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.208638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5d29-f545-488a-833a-bf5db7472593 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:21.209804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032339-122e-471e-978f-4294876d42e2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.210247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032339-122e-471e-978f-4294876d42e2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.210529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f032339-122e-471e-978f-4294876d42e2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.212012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:21.212323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 414/835] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:21.217346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8074e-674f-42ed-93a2-474d16d48809 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.217731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8074e-674f-42ed-93a2-474d16d48809 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.218631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8074e-674f-42ed-93a2-474d16d48809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.236182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8db8074e-674f-42ed-93a2-474d16d48809 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:21.237528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8db8074e-674f-42ed-93a2-474d16d48809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:21.250347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99d60f-60cb-44a2-b844-b4a7e23d094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:21.251154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99d60f-60cb-44a2-b844-b4a7e23d094f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.251440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99d60f-60cb-44a2-b844-b4a7e23d094f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.252028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99d60f-60cb-44a2-b844-b4a7e23d094f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.252166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:21.266453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99d60f-60cb-44a2-b844-b4a7e23d094f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-bb99d60f-60cb-44a2-b844-b4a7e23d094f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:21.276517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:21.277455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:21.278722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 422/836] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:21.284577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99d60f-60cb-44a2-b844-b4a7e23d094f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.309311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 415/837] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:21.332973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8074e-674f-42ed-93a2-474d16d48809 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.391202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99d60f-60cb-44a2-b844-b4a7e23d094f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:21.428209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:21.428888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.429272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.429554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.430312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:21.430616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:21.432116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:21.435189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8074e-674f-42ed-93a2-474d16d48809 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:21.445324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 423/838] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:21.446462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.471720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8daa416-cd90-444a-9f8f-a4d2daf2a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:21.472618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daa416-cd90-444a-9f8f-a4d2daf2a06b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.473051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daa416-cd90-444a-9f8f-a4d2daf2a06b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.473459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daa416-cd90-444a-9f8f-a4d2daf2a06b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.477190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:21.485060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8daa416-cd90-444a-9f8f-a4d2daf2a06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d8daa416-cd90-444a-9f8f-a4d2daf2a06b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:21.494608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:21.495532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:21.496385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:21.500763 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 416/839] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:21.501740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8daa416-cd90-444a-9f8f-a4d2daf2a06b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.513855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:21.559625 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d755d-d3cb-43bd-b5ba-c27e12ba59b3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:21.603137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:21.604857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.605307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.605727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.606634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8daa416-cd90-444a-9f8f-a4d2daf2a06b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:21.619757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:21.623852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:21.642714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:21.643471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.643816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.644177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.645038 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:21.645423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:21.646900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:21.649123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:21.650177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:21.651250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:21.651250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:21.651250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:21.651250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:21.658846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 424/840] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:21.659294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.667559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 417/841] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:21.668574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.756909 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:21.782426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581498-a948-4f95-9a74-8f411ff0f2e2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:21.826515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:21.828420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.829019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.829506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.831532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:21.832124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:21.833754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:21.854380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 425/842] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:21.855853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.875067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:21.916442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896d8c6-594d-4d68-80f0-0420a6e5bc54 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:21.951612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ad2f-7850-4da3-80c2-dba6681b7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:21.952981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ad2f-7850-4da3-80c2-dba6681b7534 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.953258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ad2f-7850-4da3-80c2-dba6681b7534 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.953528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ad2f-7850-4da3-80c2-dba6681b7534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.965077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ad2f-7850-4da3-80c2-dba6681b7534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:21.966558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ad2f-7850-4da3-80c2-dba6681b7534 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6926ad2f-7850-4da3-80c2-dba6681b7534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:21.984408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:21.985335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:21.991137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:21.991137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:21.991137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:21.991137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:21.991137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 418/843] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:21.991410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fc7e7-71d0-46dc-bc74-c0dad51f24f4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:21.991803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440cb6-4795-486b-a880-743db6eb7807 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.991803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440cb6-4795-486b-a880-743db6eb7807 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.991803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440cb6-4795-486b-a880-743db6eb7807 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.991803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 419/844] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:21.993555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440cb6-4795-486b-a880-743db6eb7807 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.027799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce9ca8-b4f1-4089-9d5b-428430b8ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.028749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9ca8-b4f1-4089-9d5b-428430b8ff0e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.029039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9ca8-b4f1-4089-9d5b-428430b8ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.029309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce9ca8-b4f1-4089-9d5b-428430b8ff0e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.037575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce9ca8-b4f1-4089-9d5b-428430b8ff0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.039233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce9ca8-b4f1-4089-9d5b-428430b8ff0e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.041254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-87ce9ca8-b4f1-4089-9d5b-428430b8ff0e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:22.055824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:22.056999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:22.058301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:22.060326 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 426/845] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:22.062336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4cf14-d5d0-42b4-89f9-832c684b6787 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.062615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4cf14-d5d0-42b4-89f9-832c684b6787 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.062884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4cf14-d5d0-42b4-89f9-832c684b6787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.081360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f2f4cf14-d5d0-42b4-89f9-832c684b6787 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:22.082534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f2f4cf14-d5d0-42b4-89f9-832c684b6787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:22.109024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440cb6-4795-486b-a880-743db6eb7807 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.134091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.146700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.147341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.147622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.147901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.148705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:22.152238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.152238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.153530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 427/846] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:22.154167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4cf14-d5d0-42b4-89f9-832c684b6787 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.167953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 420/847] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:22.171565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.270969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4cf14-d5d0-42b4-89f9-832c684b6787 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.280683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cbe70-0e56-459f-97ef-005683384ad3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.299532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.307451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.312370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.312370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.312370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.312370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:22.312370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.312370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.316082 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.316866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.317147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.317421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.324658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.326250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.329262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 428/848] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:22.330130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:22.346907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:22.347876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:22.348857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 421/849] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:22.350113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.405141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.431166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb6f29-bf15-45fd-b9a9-037dfc0c582d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.465877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.466675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.466947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.467222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.467901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.469282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.469479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77aca0-7b36-4b50-bfe5-836ca9746b50 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:22.486747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:22.487881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:22.488763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 429/850] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:22.489644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.511510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4e8b-4e73-4ac5-bb27-3beee3264fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.512206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4e8b-4e73-4ac5-bb27-3beee3264fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.512492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4e8b-4e73-4ac5-bb27-3beee3264fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.512771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4e8b-4e73-4ac5-bb27-3beee3264fe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.544242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.584419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc4e8b-4e73-4ac5-bb27-3beee3264fe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.585849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc4e8b-4e73-4ac5-bb27-3beee3264fe6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.597340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5871b62-c9de-43b4-9cbd-652a8da5ee54 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.628595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.636441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.637171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.637453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.637721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.638644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:22.639018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.640603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.664519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 430/851] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:22.664519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.696194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 422/852] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:22.697035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4e8b-4e73-4ac5-bb27-3beee3264fe6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.775100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419fce5-1e59-438e-85ea-164085a3a34b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.784757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.807970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4e8b-4e73-4ac5-bb27-3beee3264fe6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.811315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.812252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.812713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.813164 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.814053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:22.814556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.816136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.826233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 431/853] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:22.827410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.842495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ec917-9e82-4a02-81a9-47a9c85f2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.843657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ec917-9e82-4a02-81a9-47a9c85f2c1a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.843961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ec917-9e82-4a02-81a9-47a9c85f2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.844239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ec917-9e82-4a02-81a9-47a9c85f2c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.855994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.911953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ec917-9e82-4a02-81a9-47a9c85f2c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.913379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ec917-9e82-4a02-81a9-47a9c85f2c1a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.932069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa608-48c0-4f9c-b4e2-5de50015c3a7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.966335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.967118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.967473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.967778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.978723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.980190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:22.998105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:22.999505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:23.000827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:23.000827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:23.000827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:23.000827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:23.000827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 432/854] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:23.000827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.024319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 423/855] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:23.024319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ec917-9e82-4a02-81a9-47a9c85f2c1a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.032708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:23.068177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:23.114283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505295d-88a8-4135-805d-7dd6a9479c65 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.125988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ec917-9e82-4a02-81a9-47a9c85f2c1a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.147798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.148473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.148754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.149027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.149746 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:23.150036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.151374 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.156275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 433/856] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:23.157033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.159830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3c104-4482-4f37-abe5-823dc920a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.160641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3c104-4482-4f37-abe5-823dc920a057 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.160923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3c104-4482-4f37-abe5-823dc920a057 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.161198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3c104-4482-4f37-abe5-823dc920a057 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.161928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3c104-4482-4f37-abe5-823dc920a057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:23.162232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3c104-4482-4f37-abe5-823dc920a057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.163626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3c104-4482-4f37-abe5-823dc920a057 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.176456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 424/857] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:23.177821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afa8c4-0999-4443-8bf8-04b474324259 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.178103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afa8c4-0999-4443-8bf8-04b474324259 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.178374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afa8c4-0999-4443-8bf8-04b474324259 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.179944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 425/858] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:23.184838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afa8c4-0999-4443-8bf8-04b474324259 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.264346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:23.278558 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a6c5-5173-43c0-82f5-37a2947a9333 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.295076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afa8c4-0999-4443-8bf8-04b474324259 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.296951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:23.316627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a4ba-cb4d-4f74-b839-254a7f8b68cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.317424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a4ba-cb4d-4f74-b839-254a7f8b68cc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.317716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a4ba-cb4d-4f74-b839-254a7f8b68cc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.317979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a4ba-cb4d-4f74-b839-254a7f8b68cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.329375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a4ba-cb4d-4f74-b839-254a7f8b68cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.330826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a4ba-cb4d-4f74-b839-254a7f8b68cc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.337745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.338675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.338796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.339067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.346423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.347843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0eb2a4ba-cb4d-4f74-b839-254a7f8b68cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:23.350039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:23.350868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:23.351739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:23.351739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:23.351739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:23.351739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:23.351739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 434/859] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:23.352703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceb35d-6b86-4e7a-8de8-7fda732640f6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.352901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceb35d-6b86-4e7a-8de8-7fda732640f6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.353162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceb35d-6b86-4e7a-8de8-7fda732640f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:23.368641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:23.369541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:23.370423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:23.370423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:23.370423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:23.370423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:23.370423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:23.370423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:23.370423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:23.370423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:23.370845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-55ceb35d-6b86-4e7a-8de8-7fda732640f6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:23.370917 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 426/860] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:23.370917 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.376261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-55ceb35d-6b86-4e7a-8de8-7fda732640f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:23.446382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 435/861] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:23.447528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceb35d-6b86-4e7a-8de8-7fda732640f6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.489945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded09f-42bf-4c80-b0cd-ab380f789a54 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.519807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:23.525072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.525741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.526022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.526300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.527019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:23.527324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.528715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.545425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 427/862] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:23.545425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.557880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceb35d-6b86-4e7a-8de8-7fda732640f6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.570290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:23.594875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.595687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.595995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.596267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.597345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:23.597654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.599066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.611797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 436/863] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:23.612454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.654790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063873f3-3975-4a10-baa0-0eb856827649 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.692174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.692983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.693264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.693536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.694187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.695547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:23.708238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:23.709130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:23.709950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 428/864] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:23.710786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.721112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb584-7448-4413-a119-b2ffbd571e1b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.751841 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:23.757880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.759007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.759347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.759682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.766332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.767877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:23.782499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:23.783401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:23.784319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 437/865] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:23.784873 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.818068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:23.833307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121afaa-a596-4793-af1d-9f99eaf56332 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.870187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.870922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.871244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.871467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.872318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=21cd048d475f481393fd7749e4335c6a) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:23.872743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.874902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.888191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 429/866] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/role_assignments?user.id=21cd048d475f481393fd7749e4335c6a&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:23.888191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:23.906660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8834d-b5b7-48d7-8306-f5e6a000d360 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:23.952183 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:23.952969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:23.953322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:23.953813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:23.954693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:23.955070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:23.956622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:23.962619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 438/867] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:23.968787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:24.026125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dd4d9-7e03-4916-952c-4c9a0945a881 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:24.047554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:24.067508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:24.068519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:24.068799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:24.069076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:24.069861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:24.070172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:24.071633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:24.087756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 430/868] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:24.094326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:24.108238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:24.111997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3151c1-0cda-4dd7-bd83-fa5215d02677 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:24.152423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d9940-c3fb-497c-97ec-7de810ffae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:24.153197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d9940-c3fb-497c-97ec-7de810ffae2e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:24.153559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d9940-c3fb-497c-97ec-7de810ffae2e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:24.153905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d9940-c3fb-497c-97ec-7de810ffae2e None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:24.155163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d9940-c3fb-497c-97ec-7de810ffae2e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:24.155163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d9940-c3fb-497c-97ec-7de810ffae2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:24.156947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d9940-c3fb-497c-97ec-7de810ffae2e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:24.161823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 439/869] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:24.227055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742033-98c6-40ca-b86a-9e8312367573 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:24.269553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220d508-7dcc-4579-b4d3-5a0a77568364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:24.270277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220d508-7dcc-4579-b4d3-5a0a77568364 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:24.270556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220d508-7dcc-4579-b4d3-5a0a77568364 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:24.270829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220d508-7dcc-4579-b4d3-5a0a77568364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:24.271711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220d508-7dcc-4579-b4d3-5a0a77568364 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=7835f273e70a411fa7f8ee57395861f3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:24.272069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220d508-7dcc-4579-b4d3-5a0a77568364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:24.273665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220d508-7dcc-4579-b4d3-5a0a77568364 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:24.280904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 431/870] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:24 2022] GET /identity/v3/role_assignments?user.id=7835f273e70a411fa7f8ee57395861f3&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:25.308317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da28fc-e8a7-4b07-86f2-97a8861b7019 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:25.308837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da28fc-e8a7-4b07-86f2-97a8861b7019 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:25.308837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da28fc-e8a7-4b07-86f2-97a8861b7019 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:25.310467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 440/871] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:25.315506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571410d3-422d-4b0e-8fde-96b86661d82c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:25.315899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571410d3-422d-4b0e-8fde-96b86661d82c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:25.316152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571410d3-422d-4b0e-8fde-96b86661d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:25.332974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-571410d3-422d-4b0e-8fde-96b86661d82c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:25.334136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-571410d3-422d-4b0e-8fde-96b86661d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:25.400018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 432/872] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:25.423028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da28fc-e8a7-4b07-86f2-97a8861b7019 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:25.527829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da28fc-e8a7-4b07-86f2-97a8861b7019 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:25.545519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:25.569129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c54b2-ecfb-4e58-9982-653f811eff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:25.570068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c54b2-ecfb-4e58-9982-653f811eff11 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:25.570549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c54b2-ecfb-4e58-9982-653f811eff11 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:25.571033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c54b2-ecfb-4e58-9982-653f811eff11 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:25.571989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c54b2-ecfb-4e58-9982-653f811eff11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:25.573606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c54b2-ecfb-4e58-9982-653f811eff11 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:25.655650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 441/873] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:25 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:26.234161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58d8ad-8e2e-4569-b5da-e46f3b526c14 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.234440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58d8ad-8e2e-4569-b5da-e46f3b526c14 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.234992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58d8ad-8e2e-4569-b5da-e46f3b526c14 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.236842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 433/874] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:26.242210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47c6e0-08bb-4eb3-a2cf-2499e96ed03c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.242497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47c6e0-08bb-4eb3-a2cf-2499e96ed03c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.242989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47c6e0-08bb-4eb3-a2cf-2499e96ed03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.261001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4c47c6e0-08bb-4eb3-a2cf-2499e96ed03c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:26.262463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4c47c6e0-08bb-4eb3-a2cf-2499e96ed03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:26.345242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 442/875] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:26.357179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978488e-0ad8-4488-8abe-f5d4c3766386 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.357983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978488e-0ad8-4488-8abe-f5d4c3766386 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.359027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978488e-0ad8-4488-8abe-f5d4c3766386 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.360591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 434/876] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:26.366074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eaaf3-0ce5-4e14-8621-ca623297ed25 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.366629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eaaf3-0ce5-4e14-8621-ca623297ed25 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.367154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eaaf3-0ce5-4e14-8621-ca623297ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.368356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978488e-0ad8-4488-8abe-f5d4c3766386 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:26.372315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:26.384956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7f5eaaf3-0ce5-4e14-8621-ca623297ed25 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:26.386188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7f5eaaf3-0ce5-4e14-8621-ca623297ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:26.468248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 443/877] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:26.478631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978488e-0ad8-4488-8abe-f5d4c3766386 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:26.479941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723717ae-1e77-4245-a587-75f5a1d00e40 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.480253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723717ae-1e77-4245-a587-75f5a1d00e40 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.480537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723717ae-1e77-4245-a587-75f5a1d00e40 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.482244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 444/878] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:26.487381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723717ae-1e77-4245-a587-75f5a1d00e40 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:26.516387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40968686-b2a3-468f-baf9-424dad0ebeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:26.517188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40968686-b2a3-468f-baf9-424dad0ebeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.517471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40968686-b2a3-468f-baf9-424dad0ebeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.517898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40968686-b2a3-468f-baf9-424dad0ebeb5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.521999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:26.529160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40968686-b2a3-468f-baf9-424dad0ebeb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-40968686-b2a3-468f-baf9-424dad0ebeb5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:26.538250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:26.539160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:26.540050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:26.544225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 435/879] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:26.545459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560be2-ca5d-4e97-8e9c-9c486afd723f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.545723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560be2-ca5d-4e97-8e9c-9c486afd723f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.546614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560be2-ca5d-4e97-8e9c-9c486afd723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.563342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-34560be2-ca5d-4e97-8e9c-9c486afd723f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:26.564562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-34560be2-ca5d-4e97-8e9c-9c486afd723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:26.590359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723717ae-1e77-4245-a587-75f5a1d00e40 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:26.625220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:26.625631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310452c-9af6-4217-890e-974f750ee024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:26.626280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310452c-9af6-4217-890e-974f750ee024 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.626555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310452c-9af6-4217-890e-974f750ee024 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.626824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310452c-9af6-4217-890e-974f750ee024 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.627531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310452c-9af6-4217-890e-974f750ee024 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:26.628903 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310452c-9af6-4217-890e-974f750ee024 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:26.634685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 436/880] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:26.635735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34560be2-ca5d-4e97-8e9c-9c486afd723f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:26.736393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34560be2-ca5d-4e97-8e9c-9c486afd723f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:26.743095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 445/881] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:26 2022] POST /identity/v3/services => generated 269 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:23:26.749620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310452c-9af6-4217-890e-974f750ee024 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:26.803269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:26.804747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.805037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.805316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.806125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:26.806440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:26.807896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:26.821411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 437/882] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:26.827118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:26.881182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:26.890097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310452c-9af6-4217-890e-974f750ee024 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:26.901324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:26.939190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:26.940082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:26.940369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:26.940643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:26.941295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:26.942647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:26.955062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:26.956073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:26.956919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 446/883] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:26.963523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e05689-6c64-4aa8-b0d1-dd792a924164 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:26.963683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:27.003414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:27.004165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.004454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.004734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.016255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:27.017713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:27.035941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:27.036854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:27.037789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:27.037789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:27.037789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:27.037789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:27.037789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 438/884] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:27.042979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:27.095474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09803365-1f64-4b93-b57f-a59ba7b6190e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:27.132697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:27.133506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.134059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.134333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.135134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:27.135441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:27.136948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:27.143049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 447/885] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:27.148342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:27.153241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfc467-2124-4e8c-82b8-a2c7a25d4398 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:27.156244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:27.175217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:27.188484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:27.189146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.189430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.189709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.190426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:27.190734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:27.195897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:27.213120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 439/886] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:27.219465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:27.268774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863b7d6-5847-4b42-9216-6b886060a564 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:27.305548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:27.306195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.306458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.306739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.307453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:27.307763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:27.309211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:27.315981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 448/887] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:27.354760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f477a-202b-450e-9191-94b14202fd9f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:27.395083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:27.395921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.396216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.396494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.405770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:27.407252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:27.424757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:27.425761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:27.426680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 440/888] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:23:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:27.432062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:27.525560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:27.541108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430c235-b511-4b41-a028-aadf46dea2c9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:27.575077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c50ccf-33af-469c-a278-b043b4363fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:27.576136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50ccf-33af-469c-a278-b043b4363fbe None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.576614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50ccf-33af-469c-a278-b043b4363fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.577599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50ccf-33af-469c-a278-b043b4363fbe None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.578735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c50ccf-33af-469c-a278-b043b4363fbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:27.579275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c50ccf-33af-469c-a278-b043b4363fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:27.580908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c50ccf-33af-469c-a278-b043b4363fbe None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:27.599524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 449/889] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jun 15 00:23:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:27.605205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:27.631705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:27.711534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684eccd-8cfc-4856-a034-088bdea802a0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:27.746450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71a309-8642-41e3-826d-8885629cfe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:27.747110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71a309-8642-41e3-826d-8885629cfe0d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.747399 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71a309-8642-41e3-826d-8885629cfe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.747680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71a309-8642-41e3-826d-8885629cfe0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.821799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71a309-8642-41e3-826d-8885629cfe0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:27.823256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71a309-8642-41e3-826d-8885629cfe0d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:27.849447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:27.849991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cbc9-a7cc-4c98-a2fd-c830f24f7151 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.850681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cbc9-a7cc-4c98-a2fd-c830f24f7151 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.850959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6cbc9-a7cc-4c98-a2fd-c830f24f7151 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.852496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 450/890] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:27.859643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a359e-2f5c-41db-85d6-08395c9ba8f7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.861505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a359e-2f5c-41db-85d6-08395c9ba8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.861505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a359e-2f5c-41db-85d6-08395c9ba8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.883103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-734a359e-2f5c-41db-85d6-08395c9ba8f7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:27.886253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-734a359e-2f5c-41db-85d6-08395c9ba8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:27.941247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 441/891] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:27 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:27.948889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71a309-8642-41e3-826d-8885629cfe0d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:27.980024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 451/892] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:27.998829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a359e-2f5c-41db-85d6-08395c9ba8f7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.055545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71a309-8642-41e3-826d-8885629cfe0d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.080040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.082677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.094308 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.096849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.096849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.096849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.107421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.109321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.111277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a359e-2f5c-41db-85d6-08395c9ba8f7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:28.128424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:28.129416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:28.130594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:28.130594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:28.130594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:28.130594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:28.137501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 442/893] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:28.137501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.159157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.160359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.160818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.161263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.162146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.163697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:28.176036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:28.176995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:28.177855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:28.185350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 452/894] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:28.187330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.250849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf4272-1fbf-452b-8b22-c3d86f31c10c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.288974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.290282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.290647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.291000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.291789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:28.292192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.294610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.299834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f0be9-4001-4914-9b26-84fc2843f9f2 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.311988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 443/895] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:28.315785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.344201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.344840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.345122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.345397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.346212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:28.346448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.347822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.357371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 453/896] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:28.358691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.361486 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.364098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.435636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a6557-790a-4815-9484-50ba768d1f59 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.464386 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca67256-4c83-45bc-89cf-6af0300f4959 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.476649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.477771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.478645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.479132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.489555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.491010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:28.505435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:28.506354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:28.507257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:28.507257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:28.507257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:28.507257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:28.507257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:28.507257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:28.507257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:28.507257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:28.510850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.511637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 444/897] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:28.512075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.512560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.512886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.513356 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.514324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:28.515406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.518370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.525999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 454/898] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:28.532418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.618934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.625331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.632431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99e40a-2a27-4385-9fad-72df62383899 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.660336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bc39a-7c6b-4fa7-a65b-e677071dbc2b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.673018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.673489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.673776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.674051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.674839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:28.675148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.676638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.694777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 445/899] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:28.696171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.700646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.701511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.702531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.702987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.703978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] RBAC: Adding query filter params (interface=public, service_id=497b72c83e9b4a458111fb6484335819, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:28.704473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.706103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.712026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 455/900] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/endpoints?service_id=497b72c83e9b4a458111fb6484335819&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:28.721167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.841807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a6e0-4ede-4038-a1f9-4b61d4309a12 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.847455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb53ef-9fe2-49bd-9b16-3ff425a12d1c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.882092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.887517 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e0423-6207-4785-bf84-92905efcc169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.888146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d513499-b0c2-4d70-a5d4-0c5c8ae31eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.888752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0423-6207-4785-bf84-92905efcc169 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.888862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513499-b0c2-4d70-a5d4-0c5c8ae31eab None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.889071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513499-b0c2-4d70-a5d4-0c5c8ae31eab None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.889385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d513499-b0c2-4d70-a5d4-0c5c8ae31eab None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.890280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0423-6207-4785-bf84-92905efcc169 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.890665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d513499-b0c2-4d70-a5d4-0c5c8ae31eab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.890969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e0423-6207-4785-bf84-92905efcc169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.892132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d513499-b0c2-4d70-a5d4-0c5c8ae31eab None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.892359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0423-6207-4785-bf84-92905efcc169 None admin] RBAC: Adding query filter params (role.id=5192b499fc6b422b87abb6329aaa5ab4, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=21cd048d475f481393fd7749e4335c6a) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:28.892889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0423-6207-4785-bf84-92905efcc169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.897037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e0423-6207-4785-bf84-92905efcc169 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.907981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 456/902] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:23:28.908434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 446/902] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/role_assignments?user.id=21cd048d475f481393fd7749e4335c6a&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5192b499fc6b422b87abb6329aaa5ab4 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:29.033479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f850-239d-450d-96ae-4b8269aa4de6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.033810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f850-239d-450d-96ae-4b8269aa4de6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.034034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f850-239d-450d-96ae-4b8269aa4de6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.035747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 457/903] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:29.041584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5696-c53e-48bb-8f79-4a8373947912 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.042031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5696-c53e-48bb-8f79-4a8373947912 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.042408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5696-c53e-48bb-8f79-4a8373947912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.063163 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-70ca5696-c53e-48bb-8f79-4a8373947912 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:29.064459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-70ca5696-c53e-48bb-8f79-4a8373947912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:29.081494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:29.141902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 447/904] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:29.165432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f850-239d-450d-96ae-4b8269aa4de6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:29.272161 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f850-239d-450d-96ae-4b8269aa4de6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:29.314806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:29.316483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.317201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.317730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.318721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:29.320863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:29.336388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:29.337499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:29.338407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:29.341666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 458/905] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jun 15 00:23:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:29.347720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca5696-c53e-48bb-8f79-4a8373947912 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:29.455446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca5696-c53e-48bb-8f79-4a8373947912 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:29.493823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed878da-ec6c-4464-9394-41fe17c4acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:29.494512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed878da-ec6c-4464-9394-41fe17c4acbb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.494792 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed878da-ec6c-4464-9394-41fe17c4acbb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.495064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed878da-ec6c-4464-9394-41fe17c4acbb None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.495790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed878da-ec6c-4464-9394-41fe17c4acbb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:29.496116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed878da-ec6c-4464-9394-41fe17c4acbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:29.497518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed878da-ec6c-4464-9394-41fe17c4acbb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:29.504045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 448/906] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:29.511239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:29.543613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67402cf-e76f-41fd-a6d4-b88ddfa97246 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.543974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67402cf-e76f-41fd-a6d4-b88ddfa97246 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.544199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67402cf-e76f-41fd-a6d4-b88ddfa97246 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.546207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 449/907] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:29.551111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4e1e-9d93-4751-a2eb-a501d1fc6233 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.551392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4e1e-9d93-4751-a2eb-a501d1fc6233 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.551659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4e1e-9d93-4751-a2eb-a501d1fc6233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.568577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6d0f4e1e-9d93-4751-a2eb-a501d1fc6233 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:29.569747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6d0f4e1e-9d93-4751-a2eb-a501d1fc6233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:29.578845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:29.580290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:29.627322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae9aaf-c0e4-443d-9570-4d0a9075dadf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:29.641674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 450/908] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:29.664956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f4e1e-9d93-4751-a2eb-a501d1fc6233 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:29.673544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:29.674652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.674943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.675214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.675941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:29.676316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:29.678094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:29.685251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 459/909] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:29.691309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:29.802579 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f4e1e-9d93-4751-a2eb-a501d1fc6233 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:29.819071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385960b-b782-47a3-b152-2abe64f6b6f7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:29.847227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104919d0-2c49-4193-bb4a-9077cfe14a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:29.847875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:29.849839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104919d0-2c49-4193-bb4a-9077cfe14a26 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.850400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104919d0-2c49-4193-bb4a-9077cfe14a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.850869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104919d0-2c49-4193-bb4a-9077cfe14a26 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.852158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104919d0-2c49-4193-bb4a-9077cfe14a26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:29.853414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104919d0-2c49-4193-bb4a-9077cfe14a26 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:29.864300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:29.864951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:29.865226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:29.865497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:29.866272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] RBAC: Adding query filter params (interface=public, service_id=ff5eb19064c84b3f90d7ee835a4dc88a, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:29.866578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:29.867944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:29.873008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 460/910] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:29 2022] GET /identity/v3/endpoints?service_id=ff5eb19064c84b3f90d7ee835a4dc88a&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:29.878217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:29.944582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 451/911] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:29 2022] POST /identity/v3/services => generated 241 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:29.990527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843908eb-ac2c-4852-95e2-7b5c48360b4d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:30.037379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3adfbe-163e-4207-acd5-ee9e7743f5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:30.038059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3adfbe-163e-4207-acd5-ee9e7743f5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:30.038337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3adfbe-163e-4207-acd5-ee9e7743f5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:30.038610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3adfbe-163e-4207-acd5-ee9e7743f5a4 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:30.039292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3adfbe-163e-4207-acd5-ee9e7743f5a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:30.040751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3adfbe-163e-4207-acd5-ee9e7743f5a4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:30.048757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 461/912] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:29 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:23:31.132591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82d03-ad91-46f9-aacd-cdf73f3f7b37 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.133136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82d03-ad91-46f9-aacd-cdf73f3f7b37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.133136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82d03-ad91-46f9-aacd-cdf73f3f7b37 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.135128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 452/913] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:31.141479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925680d4-ed93-4ecb-9144-3a8fc87878ba None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.142040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925680d4-ed93-4ecb-9144-3a8fc87878ba None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.142040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925680d4-ed93-4ecb-9144-3a8fc87878ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.158183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447cda-ec27-4ea2-8218-3e6fdff459d1 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.158512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447cda-ec27-4ea2-8218-3e6fdff459d1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.158736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447cda-ec27-4ea2-8218-3e6fdff459d1 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.160410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 453/914] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:31.164224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-925680d4-ed93-4ecb-9144-3a8fc87878ba None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:31.165634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-925680d4-ed93-4ecb-9144-3a8fc87878ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:31.169044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820a98-5984-44b5-bccf-aa72dc9e2da9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.169332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820a98-5984-44b5-bccf-aa72dc9e2da9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.169609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820a98-5984-44b5-bccf-aa72dc9e2da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.178464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:31.189751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-61820a98-5984-44b5-bccf-aa72dc9e2da9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:31.191058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-61820a98-5984-44b5-bccf-aa72dc9e2da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:31.222957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:31.253111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 462/915] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:31.273873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 454/916] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:31.279640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925680d4-ed93-4ecb-9144-3a8fc87878ba None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.297153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820a98-5984-44b5-bccf-aa72dc9e2da9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.395986 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925680d4-ed93-4ecb-9144-3a8fc87878ba None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.396176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820a98-5984-44b5-bccf-aa72dc9e2da9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.430077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80176630-23e6-4d9c-8361-b64bc96fc693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.430880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176630-23e6-4d9c-8361-b64bc96fc693 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.431159 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176630-23e6-4d9c-8361-b64bc96fc693 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.431432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176630-23e6-4d9c-8361-b64bc96fc693 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.433303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:31.436437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.437503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.438002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.438483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.439330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.441006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80176630-23e6-4d9c-8361-b64bc96fc693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-80176630-23e6-4d9c-8361-b64bc96fc693 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:31.451197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:31.452685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:31.453822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:31.457137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 455/917] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:31.457399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:31.458353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:23:31.459160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:31.459862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80176630-23e6-4d9c-8361-b64bc96fc693 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.465940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 463/918] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:31.468868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.515107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:31.568015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80176630-23e6-4d9c-8361-b64bc96fc693 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.582325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a2b64-73df-4cf9-8332-ef5bbacb5d64 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.602568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.603233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.603511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.603783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.604552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:31.604854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.606396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.619229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 456/919] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:31.620114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.622297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.623200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.624302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.624931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.625990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:31.626508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.628117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.638592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 464/920] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:31.640828 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.679113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:31.723416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809aeee-accc-4153-928f-5483aa321138 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.753582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab461-844e-4c01-a40d-07bd01e90b48 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.756292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:31.770949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.771866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.772268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.772706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.783997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.785494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.794441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.795289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.795782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.796254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.797162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:31.797653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.799235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:31.803612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:31.804553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:31.805421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:31.805421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:31.805421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:31.805421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:31.805421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 457/921] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:31.811996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 465/922] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:31.813315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.813933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.919053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008477-8e44-408e-9428-e8cd7723048c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.923710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a73f5d-d6a9-45b0-813e-ffd54d64fcca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.929267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:31.955979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.956818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.957200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.957809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.958545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:31.958896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.960391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.962974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acce23-4582-4334-a38e-8c1b25acd305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.963792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acce23-4582-4334-a38e-8c1b25acd305 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.964248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acce23-4582-4334-a38e-8c1b25acd305 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.964687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acce23-4582-4334-a38e-8c1b25acd305 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.965586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acce23-4582-4334-a38e-8c1b25acd305 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.967296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acce23-4582-4334-a38e-8c1b25acd305 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.978069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 458/923] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:31.979185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.048071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 466/924] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:32.104952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4a732-cd39-4b6f-ae23-fbe66a472e98 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:32.137252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92563-d22a-4e09-9fca-e5057241325a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.137669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92563-d22a-4e09-9fca-e5057241325a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.137791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92563-d22a-4e09-9fca-e5057241325a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.139627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 467/925] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:32.145602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf1ff4-7628-4f2c-98fc-f0f10033c34a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.146263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf1ff4-7628-4f2c-98fc-f0f10033c34a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.146263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf1ff4-7628-4f2c-98fc-f0f10033c34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.156457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:32.157299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.157581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.157855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.167060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b0bf1ff4-7628-4f2c-98fc-f0f10033c34a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:32.167532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:32.168332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b0bf1ff4-7628-4f2c-98fc-f0f10033c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:32.169039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:32.190900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:32.191871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:32.193479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 459/926] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:32.194637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:32.198146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.225326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:32.255885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 468/927] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:32.257482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f4e5-d269-4006-98a3-cbce5496715f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.257766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f4e5-d269-4006-98a3-cbce5496715f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.258045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f4e5-d269-4006-98a3-cbce5496715f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.259807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 469/928] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:32.265037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640255b8-4229-4f6e-b92d-5abc45f098ed None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.265322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640255b8-4229-4f6e-b92d-5abc45f098ed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.265601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640255b8-4229-4f6e-b92d-5abc45f098ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.284911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-640255b8-4229-4f6e-b92d-5abc45f098ed None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:32.286506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-640255b8-4229-4f6e-b92d-5abc45f098ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:32.317636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c9fa-ddef-4d6d-bf17-552ae8ba44f6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:32.354068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:32.354741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.355028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.355310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.356159 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:32.356472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:32.357347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 470/929] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:32.358036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:32.366162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640255b8-4229-4f6e-b92d-5abc45f098ed None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.379732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 460/930] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:32.381083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.454138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:32.470059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640255b8-4229-4f6e-b92d-5abc45f098ed None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:32.481313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:32.500906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a25904-fb06-42b0-a7ca-c2273387bf06 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:32.508939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:32.509795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.510087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.510419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.511127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:32.512658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:32.525865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:32.526853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:32.527690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 471/931] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:32.529137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.542014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:32.542980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.543260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.543534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.544215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:32.546235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:32.558497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:32.559457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:32.560340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 461/932] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:32.561409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.640627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d7374-b419-48b1-81ab-8d7da654f9f3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:32.671455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707f12-3946-4829-b9e1-85dca8c41728 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:32.675667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:32.676557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.676840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.677117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.722357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:32.722357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:32.722357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:32.722587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:32.722587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.722587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.722587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.722938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:32.722938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:32.722938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:32.723135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:32.724132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:32.725051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:32.725051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:32.725051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:32.725051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:32.725051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 472/933] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:32.725051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.728513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 462/934] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:32.731945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.763795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:32.843763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7e2a-fab4-45ca-9105-cf281eb082ba None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:32.849398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4511ce-1001-42a9-ac8e-40280ff09981 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:32.879190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:32.879859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.880171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.880451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.881166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:32.881463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:32.882823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:32.883894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:32.884572 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:32.884845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:32.885124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:32.885830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:32.886134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:32.887457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:32.892905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 473/935] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:32.892905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.904831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 463/936] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:32.905744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:32.963722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:32.978112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:33.002970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc58b0e-b62c-4a7a-b064-7323449f4a88 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.012701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e947cf-bd6f-413e-8c73-cafaed3889b4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.038026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.038923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.039210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.039490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.040231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:33.040542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.042046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.052269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 474/937] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:33.052269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:33.054629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.055295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.055576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.055849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.057138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:33.057138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.058240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.064136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 464/938] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:33.064757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:33.159599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa193f-fef2-4546-8158-469c86658d4e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.181311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a20ce-099f-4737-8d18-8cec595d3e33 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.186267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:33.194012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.194821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.195108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.195385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.202893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.204421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:33.220280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:33.221408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:33.222481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:33.222481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:33.222481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:33.222481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:33.222481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:33.222481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:33.222481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:33.222481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:33.226364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.226539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 475/939] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:33.227318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.227435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:33.227959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.228425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.229359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] RBAC: Adding query filter params (interface=public, service_id=2a73deb2727240da8d81967bd58a250e, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:33.229970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.232354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.235191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:33.247834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 465/940] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:33 2022] GET /identity/v3/endpoints?service_id=2a73deb2727240da8d81967bd58a250e&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:33.247834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:33.334275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae3536-38f1-4e83-8410-86fbca5c634e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.354356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f4df7-7783-4c3f-b45a-00b3d80450fb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.373268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aafed8-2d09-45ae-8949-f3e7b90880a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.374119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafed8-2d09-45ae-8949-f3e7b90880a3 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.374407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafed8-2d09-45ae-8949-f3e7b90880a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.374687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafed8-2d09-45ae-8949-f3e7b90880a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.375426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aafed8-2d09-45ae-8949-f3e7b90880a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.377029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aafed8-2d09-45ae-8949-f3e7b90880a3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.388185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.389008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.389341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.389707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.390477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:33.390780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.392251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.403929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 466/941] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:33.404690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:33.462063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:33.476993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 476/942] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:33.487002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aafed8-2d09-45ae-8949-f3e7b90880a3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:33.515715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105b9f3-b001-4155-a39b-a50462289201 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.554601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:33.566301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e86de-f171-44e9-9c78-45ee43f3a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.567110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e86de-f171-44e9-9c78-45ee43f3a120 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.573198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e86de-f171-44e9-9c78-45ee43f3a120 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.573198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e86de-f171-44e9-9c78-45ee43f3a120 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.573198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e86de-f171-44e9-9c78-45ee43f3a120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.573198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e86de-f171-44e9-9c78-45ee43f3a120 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.577583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 467/943] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:33 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:23:33.625489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aafed8-2d09-45ae-8949-f3e7b90880a3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.667299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186604c-5214-4e4a-a8fd-172e8590cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.668238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186604c-5214-4e4a-a8fd-172e8590cc14 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.668525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186604c-5214-4e4a-a8fd-172e8590cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.668804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186604c-5214-4e4a-a8fd-172e8590cc14 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/21cd048d475f481393fd7749e4335c6a/roles/5192b499fc6b422b87abb6329aaa5ab4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.671712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186604c-5214-4e4a-a8fd-172e8590cc14 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=21cd048d475f481393fd7749e4335c6a, role_id=5192b499fc6b422b87abb6329aaa5ab4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.673232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186604c-5214-4e4a-a8fd-172e8590cc14 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.746700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 477/944] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:33 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/21cd048d475f481393fd7749e4335c6a/roles/5192b499fc6b422b87abb6329aaa5ab4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:23:34.266290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a1748-5a37-4a78-b408-4c0d289f8c2e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:34.266809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a1748-5a37-4a78-b408-4c0d289f8c2e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:34.266809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a1748-5a37-4a78-b408-4c0d289f8c2e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:34.268496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 468/945] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:34.276312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75321-b45f-451d-9f2e-d83deb92715a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:34.276739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75321-b45f-451d-9f2e-d83deb92715a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:34.277054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c75321-b45f-451d-9f2e-d83deb92715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:34.295125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f2c75321-b45f-451d-9f2e-d83deb92715a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:34.296392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f2c75321-b45f-451d-9f2e-d83deb92715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:34.365486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 478/946] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:34.388813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a1748-5a37-4a78-b408-4c0d289f8c2e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:34.495152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a1748-5a37-4a78-b408-4c0d289f8c2e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:34.513080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:34.536914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:34.536914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:34.536914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:34.536914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:34.537278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:34.537278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:34.537278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING keystone.server.flask.common [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 00:23:34.597277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 00:23:34.597277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 00:23:34.597277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [parameters: {'id': '3ff9fff1c20c4287975c4dd702982383', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 00:23:34.597277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ff9fff1c20c4287975c4dd702982383.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ff9fff1c20c4287975c4dd702982383. Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:23:34.605240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 15 00:23:34.606032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() Jun 15 00:23:34.607546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 00:23:34.609742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 00:23:34.611892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:23:34.617864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'id': '3ff9fff1c20c4287975c4dd702982383', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:34.619933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:34.621902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ff9fff1c20c4287975c4dd702982383. Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:34.624479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 469/947] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Jun 15 00:23:34 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:34.625587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c75321-b45f-451d-9f2e-d83deb92715a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:34.651249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:34.725829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c75321-b45f-451d-9f2e-d83deb92715a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:34.766855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84890-8fde-4935-b2db-884e606dbfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:34.767961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84890-8fde-4935-b2db-884e606dbfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:34.768451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84890-8fde-4935-b2db-884e606dbfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:34.768908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84890-8fde-4935-b2db-884e606dbfc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:34.776198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a84890-8fde-4935-b2db-884e606dbfc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:34.777877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a84890-8fde-4935-b2db-884e606dbfc9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-03a84890-8fde-4935-b2db-884e606dbfc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:34.792184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:34.793066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:34.793995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:34.793995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:34.793995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:34.793995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:34.793995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:34.793995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:34.793995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:34.793995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:34.796287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 479/948] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:34.802450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:34.912697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437cb54-6e29-43eb-b78f-feeae1f5e855 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:34.948433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cfd3e-8c8b-41d1-9cfd-251a1dae45c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:34.949347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cfd3e-8c8b-41d1-9cfd-251a1dae45c5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:34.949780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cfd3e-8c8b-41d1-9cfd-251a1dae45c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:34.950217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cfd3e-8c8b-41d1-9cfd-251a1dae45c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:34.951123 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cfd3e-8c8b-41d1-9cfd-251a1dae45c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:34.951619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cfd3e-8c8b-41d1-9cfd-251a1dae45c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:34.954045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cfd3e-8c8b-41d1-9cfd-251a1dae45c5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:34.974856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 470/949] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:35.705629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a232719-fc5c-45f0-8bde-fe4ef77faf44 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:35.706353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a232719-fc5c-45f0-8bde-fe4ef77faf44 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:35.706353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a232719-fc5c-45f0-8bde-fe4ef77faf44 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:35.707813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 480/950] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:35.713974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0981-5515-45be-bbed-6cc8a26e71a5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:35.713974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0981-5515-45be-bbed-6cc8a26e71a5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:35.713974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0981-5515-45be-bbed-6cc8a26e71a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:35.739049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f07f0981-5515-45be-bbed-6cc8a26e71a5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:35.740862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f07f0981-5515-45be-bbed-6cc8a26e71a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:35.744664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f77c-59cb-4fcc-b8c7-b0e0a17321f5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:35.744952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f77c-59cb-4fcc-b8c7-b0e0a17321f5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:35.745227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15f77c-59cb-4fcc-b8c7-b0e0a17321f5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:35.746811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 481/951] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:35.752711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d75be-fdfd-4349-a4c8-10b8b89f0dac None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:35.752996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d75be-fdfd-4349-a4c8-10b8b89f0dac None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:35.753270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d75be-fdfd-4349-a4c8-10b8b89f0dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:35.771447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cc8d75be-fdfd-4349-a4c8-10b8b89f0dac None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:35.772658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cc8d75be-fdfd-4349-a4c8-10b8b89f0dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:35.775156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:35.838611 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 471/952] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:35.851330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 482/953] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:35.858494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0981-5515-45be-bbed-6cc8a26e71a5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:35.877249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d75be-fdfd-4349-a4c8-10b8b89f0dac None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:35.911376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:35.979820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0981-5515-45be-bbed-6cc8a26e71a5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:35.994760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d75be-fdfd-4349-a4c8-10b8b89f0dac None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.015366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c5b9a-9dcc-427f-9859-b388a9e5b39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.016183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5b9a-9dcc-427f-9859-b388a9e5b39d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.016466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5b9a-9dcc-427f-9859-b388a9e5b39d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.016733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5b9a-9dcc-427f-9859-b388a9e5b39d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.017410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c5b9a-9dcc-427f-9859-b388a9e5b39d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.018743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c5b9a-9dcc-427f-9859-b388a9e5b39d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-919c5b9a-9dcc-427f-9859-b388a9e5b39d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:36.030467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:36.034207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:36.036644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 472/954] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:36.037540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17f0f-d16e-4ea2-810f-adb3c2f2e695 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.037540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17f0f-d16e-4ea2-810f-adb3c2f2e695 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.037540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17f0f-d16e-4ea2-810f-adb3c2f2e695 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.037540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 473/955] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:36.038876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17f0f-d16e-4ea2-810f-adb3c2f2e695 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.040680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71599988-0be6-4a07-8079-47128682d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.041496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71599988-0be6-4a07-8079-47128682d93d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.041779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71599988-0be6-4a07-8079-47128682d93d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.042053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71599988-0be6-4a07-8079-47128682d93d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.043297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71599988-0be6-4a07-8079-47128682d93d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.044103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71599988-0be6-4a07-8079-47128682d93d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-71599988-0be6-4a07-8079-47128682d93d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:36.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:36.063158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:36.064353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 483/956] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:36.065337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcd27d-d177-4fdb-a599-0a895ec3f21d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.065337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcd27d-d177-4fdb-a599-0a895ec3f21d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.065337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcd27d-d177-4fdb-a599-0a895ec3f21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.075713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:36.081456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b5fcd27d-d177-4fdb-a599-0a895ec3f21d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:36.082647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b5fcd27d-d177-4fdb-a599-0a895ec3f21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:36.155078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17f0f-d16e-4ea2-810f-adb3c2f2e695 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.158471 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 484/957] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:36.159333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcd27d-d177-4fdb-a599-0a895ec3f21d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.178180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:36.197801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.198468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.198747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.199050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.200010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:36.200119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.201459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.211267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 474/958] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:36.211267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.276024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcd27d-d177-4fdb-a599-0a895ec3f21d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.304008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:36.313275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38fa48-d66a-4438-94d8-9325b0232df9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.317490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.317490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.317490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.317490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.317803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:36.317803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.319052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.324582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 485/959] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:36.325428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.354907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7616952-757e-4121-9cef-2a560f08eaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.355714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7616952-757e-4121-9cef-2a560f08eaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.356019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7616952-757e-4121-9cef-2a560f08eaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.356293 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7616952-757e-4121-9cef-2a560f08eaf9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.367279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7616952-757e-4121-9cef-2a560f08eaf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f7616952-757e-4121-9cef-2a560f08eaf9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:36.376074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:36.377001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:36.377829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 475/960] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:36.378634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7616952-757e-4121-9cef-2a560f08eaf9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.418008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:36.436596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051f119-accd-4efc-9472-dde45388d700 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.472901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.473568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.473850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.474128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.474833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:36.475142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.476538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.480924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 486/961] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:36.481689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.483421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7616952-757e-4121-9cef-2a560f08eaf9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.541193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.542212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.542711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.543192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.544162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:36.544688 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.546831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.553408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 476/962] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:36.558857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.588361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:36.622999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1097-3ef5-4612-bb79-dc4f32aeda93 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.663878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.665019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.666279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.666763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.667725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:36.668799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.670903 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.681339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 487/963] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:36.688752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.703135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad0abf-11d9-4876-b096-8e4cf80c5d77 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.709528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:36.761087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa4660-c2e9-4054-9382-28403431d5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.761765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa4660-c2e9-4054-9382-28403431d5ef None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.762033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa4660-c2e9-4054-9382-28403431d5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.762309 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa4660-c2e9-4054-9382-28403431d5ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.763052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa4660-c2e9-4054-9382-28403431d5ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.764980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa4660-c2e9-4054-9382-28403431d5ef None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.819281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4ac1c-bcad-4bd9-9a6c-15ece2c0ba8f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.846926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 477/964] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:36 2022] POST /identity/v3/endpoints => generated 349 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:36.865031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.866302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.866797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.867291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.881800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.884120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:36.904689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:36.905655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:36.906582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:36.906582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:36.906582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:36.906582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:36.909066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 488/965] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:36.917979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa4660-c2e9-4054-9382-28403431d5ef None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.995368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.032648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa4660-c2e9-4054-9382-28403431d5ef None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.067695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3fe46-14fd-424a-b840-3c27af244b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.068419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3fe46-14fd-424a-b840-3c27af244b44 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.068696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3fe46-14fd-424a-b840-3c27af244b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.068970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3fe46-14fd-424a-b840-3c27af244b44 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.069751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3fe46-14fd-424a-b840-3c27af244b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:37.070003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3fe46-14fd-424a-b840-3c27af244b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.071481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3fe46-14fd-424a-b840-3c27af244b44 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.087246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 478/966] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:37.092970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.158502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.206966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9853168-8718-4190-a167-a2e75883b181 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.208853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0300-433a-4cfe-9fcf-af2866a55e2d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.209143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0300-433a-4cfe-9fcf-af2866a55e2d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.209599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0300-433a-4cfe-9fcf-af2866a55e2d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.212250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 479/967] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:37.220921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4826c-3f82-48c2-a0ed-59f38dbbb948 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.221340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4826c-3f82-48c2-a0ed-59f38dbbb948 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.221758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4826c-3f82-48c2-a0ed-59f38dbbb948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.239198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-92f4826c-3f82-48c2-a0ed-59f38dbbb948 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:37.240627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-92f4826c-3f82-48c2-a0ed-59f38dbbb948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:37.244755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.245127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.245410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.245688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.253761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.255218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:37.275504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:37.276806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:23:37.278987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:37.282242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 489/968] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:23:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:37.287154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.324695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 480/969] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:37.346287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4826c-3f82-48c2-a0ed-59f38dbbb948 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.394068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e16d-8597-456b-8d92-eedd033b9b34 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.412212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.413405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.431297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.432221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.432651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.433074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.434099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:37.434560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.436283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.456357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4826c-3f82-48c2-a0ed-59f38dbbb948 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.461375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 490/970] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jun 15 00:23:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:37.462868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.495850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.496626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.497119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.497271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.498027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.499542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.534642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 00:23:37.534642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 00:23:37.534642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [parameters: {'user_id': 'a9bd012ed4d04339b782ba5fa210ac56', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 00:23:37.534642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jun 15 00:23:37.543077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:23:37.544150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 00:23:37.545439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 00:23:37.546501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:23:37.547438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:23:37.548388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a9bd012ed4d04339b782ba5fa210ac56', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:37.549375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 15 00:23:37.550203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 15 00:23:37.551418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 15 00:23:37.551418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 15 00:23:37.551418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 00:23:37.551418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 00:23:37.551418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 00:23:37.551418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:37.551418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 481/971] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jun 15 00:23:37 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:37.551418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.581425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470846f-ea48-4767-9be5-8bcc6c52baac None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.618060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6b5e5-9247-4efa-8f00-aa0816aa3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.619047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b5e5-9247-4efa-8f00-aa0816aa3888 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.619474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b5e5-9247-4efa-8f00-aa0816aa3888 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.619936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6b5e5-9247-4efa-8f00-aa0816aa3888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.666372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e47fa-ec60-49f6-9e03-86a4f3d1e2f9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.669114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.692961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.697217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6b5e5-9247-4efa-8f00-aa0816aa3888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.698750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6b5e5-9247-4efa-8f00-aa0816aa3888 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.705873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.706882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.712198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.712198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.716595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.718503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:37.736052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:37.737266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:23:37.738374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:37.747414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 482/972] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:37.749132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.808018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 491/973] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:37 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:23:37.814049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6b5e5-9247-4efa-8f00-aa0816aa3888 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.881171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9ae6d-0184-4365-8019-57b266d10805 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.894856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.919248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6b5e5-9247-4efa-8f00-aa0816aa3888 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.928340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.929934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.930450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.930905 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.932277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:37.932604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.934038 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.962001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.962792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.963076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.963352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.974953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.976561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.984755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 483/974] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jun 15 00:23:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:37.997736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:37.999272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:38.000450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:38.000450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:38.000450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:38.000450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:38.000450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 492/975] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:38.006857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:38.066088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:38.136761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ae48e-022c-496a-8e1c-9b55eef8cffd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:38.174699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:38.175751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:38.176264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:38.176741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:38.177693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:38.178200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:38.179770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:38.196502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 484/976] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:38.199325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:38.311665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874ea00-7285-4282-86eb-5cff9a6b7a33 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:38.337295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:38.346099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:38.346886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:38.347173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:38.347449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:38.353939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:38.355382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:38.369418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:38.370331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:38.371244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:38.371244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:38.371244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:38.371244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:38.371244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:38.371244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:38.371244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:38.371244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:38.375333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 493/977] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:38.376702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:38.477768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb99968-53e2-4eec-87b6-3ec078808bcd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:38.479244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:38.512561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c8dae-1b91-42c5-8394-bc824286e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:38.513794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8dae-1b91-42c5-8394-bc824286e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:38.514146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8dae-1b91-42c5-8394-bc824286e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:38.514423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8dae-1b91-42c5-8394-bc824286e4f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:38.515218 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c8dae-1b91-42c5-8394-bc824286e4f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:38.515530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c8dae-1b91-42c5-8394-bc824286e4f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:38.516996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c8dae-1b91-42c5-8394-bc824286e4f0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:38.534012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 485/978] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:38.535600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:38.638106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99aea46-6ea3-404e-b796-5b32688e93b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:38.675370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f983a-3e25-49c5-9abc-3cf714decad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:38.676077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f983a-3e25-49c5-9abc-3cf714decad4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:38.676360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f983a-3e25-49c5-9abc-3cf714decad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:38.676635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f983a-3e25-49c5-9abc-3cf714decad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:38.677480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f983a-3e25-49c5-9abc-3cf714decad4 None admin] RBAC: Adding query filter params (role.id=5192b499fc6b422b87abb6329aaa5ab4, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=21cd048d475f481393fd7749e4335c6a) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:38.677968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f983a-3e25-49c5-9abc-3cf714decad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:38.679440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f983a-3e25-49c5-9abc-3cf714decad4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:38.691954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 494/979] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:38 2022] GET /identity/v3/role_assignments?user.id=21cd048d475f481393fd7749e4335c6a&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5192b499fc6b422b87abb6329aaa5ab4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:38.722016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1477-3e6a-4c14-87e0-d4c574ca77de None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:38.722295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1477-3e6a-4c14-87e0-d4c574ca77de None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:38.722573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f1477-3e6a-4c14-87e0-d4c574ca77de None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:38.724212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 486/980] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:38.729763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030418a-d78e-48c3-9595-434962929ec3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:38.730335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030418a-d78e-48c3-9595-434962929ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:38.730805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030418a-d78e-48c3-9595-434962929ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:38.749002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5030418a-d78e-48c3-9595-434962929ec3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:38.750228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5030418a-d78e-48c3-9595-434962929ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:38.802516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:38.824279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 495/981] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:38.848244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f1477-3e6a-4c14-87e0-d4c574ca77de None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:38.952936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f1477-3e6a-4c14-87e0-d4c574ca77de None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:38.986904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d467-6c10-4bc6-b83e-766d049ce53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:38.987489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d467-6c10-4bc6-b83e-766d049ce53c None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:38.987773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d467-6c10-4bc6-b83e-766d049ce53c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:38.988089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d467-6c10-4bc6-b83e-766d049ce53c None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:38.988817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d467-6c10-4bc6-b83e-766d049ce53c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:38.990175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d467-6c10-4bc6-b83e-766d049ce53c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:39.067964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 487/982] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:38 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:39.095757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058bda-c087-45ea-a7fb-8a3aeb2dc849 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.096134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058bda-c087-45ea-a7fb-8a3aeb2dc849 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.096413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058bda-c087-45ea-a7fb-8a3aeb2dc849 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.097935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 496/983] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:39.103744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb364ff-3643-45aa-a760-d649cdabb17b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.104069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb364ff-3643-45aa-a760-d649cdabb17b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.104351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb364ff-3643-45aa-a760-d649cdabb17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.122924 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fbb364ff-3643-45aa-a760-d649cdabb17b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:39.124738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fbb364ff-3643-45aa-a760-d649cdabb17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:39.144639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:39.210277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 488/984] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:39.234129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058bda-c087-45ea-a7fb-8a3aeb2dc849 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:39.337949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058bda-c087-45ea-a7fb-8a3aeb2dc849 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:39.372107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:39.372999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.373315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.373607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.374241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:39.375604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:39.387688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:39.388684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:39.389565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 497/985] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:39.396244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb364ff-3643-45aa-a760-d649cdabb17b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:39.495003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb364ff-3643-45aa-a760-d649cdabb17b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:39.530260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:39.530907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.531221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.531452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.532192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:39.532645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:39.533855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:39.539151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 489/986] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:39.544741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:39.594091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:39.648963 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb6b9-e59e-4900-bd77-8077fbce41ff None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:39.682774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:39.683431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.683764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.684087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.684796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:39.685103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:39.686491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:39.696078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 498/987] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:39.697300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:39.712559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:39.804913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356ab3-54eb-42f8-876a-ed3374530c15 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:39.842073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41ae6-e1d9-41e1-a3e4-e3374f79926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:39.842730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41ae6-e1d9-41e1-a3e4-e3374f79926d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.843010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41ae6-e1d9-41e1-a3e4-e3374f79926d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.843284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41ae6-e1d9-41e1-a3e4-e3374f79926d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.844168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41ae6-e1d9-41e1-a3e4-e3374f79926d None admin] RBAC: Adding query filter params (interface=admin, service_id=2a73deb2727240da8d81967bd58a250e, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:39.844427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41ae6-e1d9-41e1-a3e4-e3374f79926d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:39.845776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41ae6-e1d9-41e1-a3e4-e3374f79926d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:39.855453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 490/988] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Jun 15 00:23:39 2022] GET /identity/v3/endpoints?service_id=2a73deb2727240da8d81967bd58a250e&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:39.857026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:39.960037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cea901-87dc-450b-bdd3-00856f2ab150 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:39.968856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:39.992520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09d0ce-b2b3-4d46-8630-1011c7f902c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:39.993170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09d0ce-b2b3-4d46-8630-1011c7f902c0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.993452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09d0ce-b2b3-4d46-8630-1011c7f902c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.993725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09d0ce-b2b3-4d46-8630-1011c7f902c0 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.994422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09d0ce-b2b3-4d46-8630-1011c7f902c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:39.996278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09d0ce-b2b3-4d46-8630-1011c7f902c0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:40.003654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 499/989] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:39 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:23:40.866764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d15700-6ff6-4a8b-9fef-7783f92d5c8e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:40.867270 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d15700-6ff6-4a8b-9fef-7783f92d5c8e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:40.867345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d15700-6ff6-4a8b-9fef-7783f92d5c8e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:40.868877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 491/990] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:40.873932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69c7e-c2f7-4833-841f-0da3ce43e751 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:40.874324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69c7e-c2f7-4833-841f-0da3ce43e751 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:40.874495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69c7e-c2f7-4833-841f-0da3ce43e751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:40.891537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-58f69c7e-c2f7-4833-841f-0da3ce43e751 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:40.892766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-58f69c7e-c2f7-4833-841f-0da3ce43e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:40.959142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 500/991] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:40.981690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d15700-6ff6-4a8b-9fef-7783f92d5c8e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:41.061469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:41.086700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d15700-6ff6-4a8b-9fef-7783f92d5c8e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:41.122070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e051fdb-cde9-4ece-9495-3546033143b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:41.122867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051fdb-cde9-4ece-9495-3546033143b2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.123186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051fdb-cde9-4ece-9495-3546033143b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.123482 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051fdb-cde9-4ece-9495-3546033143b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.124251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e051fdb-cde9-4ece-9495-3546033143b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:41.125627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e051fdb-cde9-4ece-9495-3546033143b2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4e051fdb-cde9-4ece-9495-3546033143b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:41.139503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:41.140874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:41.141708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 492/992] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jun 15 00:23:40 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:41.147013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f69c7e-c2f7-4833-841f-0da3ce43e751 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:41.203405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f392239-8ff9-4a13-a252-25a78185489f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.203714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f392239-8ff9-4a13-a252-25a78185489f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.203986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f392239-8ff9-4a13-a252-25a78185489f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.205356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 493/993] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:41.210308 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae2852-e511-4ea6-8a3a-216e044c09c9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.210602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae2852-e511-4ea6-8a3a-216e044c09c9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.210888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae2852-e511-4ea6-8a3a-216e044c09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.228055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-88ae2852-e511-4ea6-8a3a-216e044c09c9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:41.229254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88ae2852-e511-4ea6-8a3a-216e044c09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:41.254120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f69c7e-c2f7-4833-841f-0da3ce43e751 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:41.255638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:41.290029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:41.290990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.291458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.291935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.292827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] RBAC: Adding query filter params (name=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:41.293285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:41.294816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:41.304074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 494/994] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:41.304221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 501/995] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:41.309040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae2852-e511-4ea6-8a3a-216e044c09c9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:41.321495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:41.383352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:41.416982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae2852-e511-4ea6-8a3a-216e044c09c9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:41.426555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19d62-dde5-4ac6-a90d-9d8ca5c151cc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:41.453210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:41.453974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.454252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.454693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.455320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:41.455620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:41.457126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:41.461866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:41.462648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.462924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.463197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.463841 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:41.465227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:41.468109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 495/996] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:41.477792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:41.478992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:41.485325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 502/997] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:41.487842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:41.597325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b293a-e8b7-4012-9115-4a95fb147fd8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:41.633852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:41.634528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.634805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.635075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.635773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:41.636107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:41.637453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:41.638536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:41.644536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 496/998] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:41.650460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:41.686122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:41.758925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a78ff-bb59-4d63-8c3f-8389024fc16c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:41.792147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:41.792805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.793081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.793415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.794127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] RBAC: Adding query filter params (type=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:41.794431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:41.796361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:41.801752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 503/999] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:41.807274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:41.907469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1e05d-4083-4b0f-8b68-5198f26d83d0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:41.941877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd8adf-581e-4dd9-b4d0-bda17cdff835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:41.942539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8adf-581e-4dd9-b4d0-bda17cdff835 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:41.942825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8adf-581e-4dd9-b4d0-bda17cdff835 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:41.943100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd8adf-581e-4dd9-b4d0-bda17cdff835 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:41.943921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd8adf-581e-4dd9-b4d0-bda17cdff835 None admin] RBAC: Adding query filter params (interface=public, service_id=9549372004024706a05fa9a8c031c02e, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:41.944253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd8adf-581e-4dd9-b4d0-bda17cdff835 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:41.945616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd8adf-581e-4dd9-b4d0-bda17cdff835 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:41.952193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 497/1000] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:41 2022] GET /identity/v3/endpoints?service_id=9549372004024706a05fa9a8c031c02e&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:41.958277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:42.054456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:42.061641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fa2db-dc3c-4c5e-a48c-a5cc47ca4eef None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:42.097652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a88fe-9b4c-48c9-a6e0-a6f32475917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:42.098403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a88fe-9b4c-48c9-a6e0-a6f32475917d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.098774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a88fe-9b4c-48c9-a6e0-a6f32475917d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.099127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a88fe-9b4c-48c9-a6e0-a6f32475917d None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.099851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a88fe-9b4c-48c9-a6e0-a6f32475917d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:42.101299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a88fe-9b4c-48c9-a6e0-a6f32475917d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:42.109254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 504/1001] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:41 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:23:42.157387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3bab-2ba4-42e4-8bb4-38fcc0fe038a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.157762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3bab-2ba4-42e4-8bb4-38fcc0fe038a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.157981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3bab-2ba4-42e4-8bb4-38fcc0fe038a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.159627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 498/1002] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:42.165303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9aa1e-9561-4637-b1a1-110bfbe0a865 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.165620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9aa1e-9561-4637-b1a1-110bfbe0a865 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.165860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9aa1e-9561-4637-b1a1-110bfbe0a865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.184262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6fa9aa1e-9561-4637-b1a1-110bfbe0a865 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:42.185476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6fa9aa1e-9561-4637-b1a1-110bfbe0a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:42.258051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 505/1003] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:42.281154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be3bab-2ba4-42e4-8bb4-38fcc0fe038a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:42.345678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:42.384434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be3bab-2ba4-42e4-8bb4-38fcc0fe038a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:42.418700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:42.419434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.419707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.420024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.420667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:42.422013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:42.433868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:42.434881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:42.436279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 499/1004] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:42.442981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9aa1e-9561-4637-b1a1-110bfbe0a865 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:42.529293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:42.541521 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9aa1e-9561-4637-b1a1-110bfbe0a865 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:42.578125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:42.578793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.579076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.579352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.580217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:42.580526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:42.581888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:42.587734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 506/1005] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:42.593520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:42.696351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f11c33-9c48-48f5-8d05-aea343aa3b73 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:42.721564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:42.735034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a00143-946e-4cec-a4d9-5978c8a9d5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:42.735034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a00143-946e-4cec-a4d9-5978c8a9d5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.735034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a00143-946e-4cec-a4d9-5978c8a9d5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.735034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a00143-946e-4cec-a4d9-5978c8a9d5a8 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.736329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a00143-946e-4cec-a4d9-5978c8a9d5a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:42.736329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a00143-946e-4cec-a4d9-5978c8a9d5a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:42.736598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a00143-946e-4cec-a4d9-5978c8a9d5a8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:42.743626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 500/1006] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:42.747756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:42.848614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45dc7e-cb9e-4f9c-a392-94bdc8944754 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:42.882176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6142a-b07b-4f2b-8bcd-574cf4f2f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:42.882827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6142a-b07b-4f2b-8bcd-574cf4f2f472 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.883105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6142a-b07b-4f2b-8bcd-574cf4f2f472 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.883376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6142a-b07b-4f2b-8bcd-574cf4f2f472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.884398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6142a-b07b-4f2b-8bcd-574cf4f2f472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:42.885744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6142a-b07b-4f2b-8bcd-574cf4f2f472 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:42.980083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 507/1007] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:23:43.601001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809d56-67a2-422c-a43a-cc5c0aec92d3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:43.601517 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809d56-67a2-422c-a43a-cc5c0aec92d3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:43.601618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809d56-67a2-422c-a43a-cc5c0aec92d3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:43.603056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 501/1008] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:43.607940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1da10-aaa7-4993-8c69-57c2e66767f6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:43.608234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1da10-aaa7-4993-8c69-57c2e66767f6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:43.608509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1da10-aaa7-4993-8c69-57c2e66767f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:43.625432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-45b1da10-aaa7-4993-8c69-57c2e66767f6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:43.626600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-45b1da10-aaa7-4993-8c69-57c2e66767f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:43.634724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:43.698114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 508/1009] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:43.720726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809d56-67a2-422c-a43a-cc5c0aec92d3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:43.828726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809d56-67a2-422c-a43a-cc5c0aec92d3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:43.860835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0e50-f492-4577-a5ba-aa5f47f947fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:43.861427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0e50-f492-4577-a5ba-aa5f47f947fd None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:43.861711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0e50-f492-4577-a5ba-aa5f47f947fd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:43.861981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0e50-f492-4577-a5ba-aa5f47f947fd None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:43.862693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0e50-f492-4577-a5ba-aa5f47f947fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:43.864126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0e50-f492-4577-a5ba-aa5f47f947fd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:43.967950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 502/1010] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:43 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:44.242046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f28a-bd01-4a72-9f8b-ff2392a2ed15 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:44.242533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f28a-bd01-4a72-9f8b-ff2392a2ed15 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:44.242533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5f28a-bd01-4a72-9f8b-ff2392a2ed15 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:44.243863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 509/1011] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:44.249927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ededfc5-609d-4015-8d25-345353989b3b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:44.250220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ededfc5-609d-4015-8d25-345353989b3b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:44.250502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ededfc5-609d-4015-8d25-345353989b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:44.267175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2ededfc5-609d-4015-8d25-345353989b3b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:44.268383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2ededfc5-609d-4015-8d25-345353989b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:44.314734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:44.342230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 503/1012] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:44 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:44.365369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5f28a-bd01-4a72-9f8b-ff2392a2ed15 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:44.469638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5f28a-bd01-4a72-9f8b-ff2392a2ed15 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:44.504346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:44.505054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:44.505336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:44.505610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:44.506262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:44.507656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:44.519787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:44.520808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:44.521641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 510/1013] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:44.529156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ededfc5-609d-4015-8d25-345353989b3b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:44.628926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ededfc5-609d-4015-8d25-345353989b3b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:44.663476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:44.664173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:44.664460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:44.664738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:44.665443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:44.665755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:44.667125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:44.677329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 504/1014] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:44.678626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:44.681602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:44.789978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25e92-30c7-4d4a-991e-9191a0af54a8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:44.822992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02999-c37b-43dc-a5ce-c9c82826f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:44.823655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02999-c37b-43dc-a5ce-c9c82826f2fd None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:44.823960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02999-c37b-43dc-a5ce-c9c82826f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:44.824240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02999-c37b-43dc-a5ce-c9c82826f2fd None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:44.824949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02999-c37b-43dc-a5ce-c9c82826f2fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:44.825257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02999-c37b-43dc-a5ce-c9c82826f2fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:44.827210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02999-c37b-43dc-a5ce-c9c82826f2fd None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:44.836879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 511/1015] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:44.838124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:44.881374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:44.940884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb61e40-4096-460a-a9f6-bc6a04fbbbd6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:44.974041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb6d27-1551-4098-b5a2-bc01aebbbe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:44.974703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb6d27-1551-4098-b5a2-bc01aebbbe06 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:44.974988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb6d27-1551-4098-b5a2-bc01aebbbe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:44.975265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb6d27-1551-4098-b5a2-bc01aebbbe06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:44.976024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb6d27-1551-4098-b5a2-bc01aebbbe06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:44.977382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb6d27-1551-4098-b5a2-bc01aebbbe06 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:45.056116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 505/1016] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:45.132713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c706c-3dcd-4bf8-a63d-445134decf40 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:45.132995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c706c-3dcd-4bf8-a63d-445134decf40 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:45.133274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c706c-3dcd-4bf8-a63d-445134decf40 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:45.134906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 512/1017] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:45.140678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200eea-7cff-4c07-9cf7-2fab8f8c603f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:45.140992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200eea-7cff-4c07-9cf7-2fab8f8c603f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:45.141255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92200eea-7cff-4c07-9cf7-2fab8f8c603f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:45.159492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-92200eea-7cff-4c07-9cf7-2fab8f8c603f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:45.160726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-92200eea-7cff-4c07-9cf7-2fab8f8c603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:45.240948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 506/1018] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:45.264159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c706c-3dcd-4bf8-a63d-445134decf40 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:45.332840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:45.369881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c706c-3dcd-4bf8-a63d-445134decf40 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:45.402451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208951d0-9fda-42a7-8191-5fa00093fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:45.403230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208951d0-9fda-42a7-8191-5fa00093fe03 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:45.403509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208951d0-9fda-42a7-8191-5fa00093fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:45.403780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208951d0-9fda-42a7-8191-5fa00093fe03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:45.405497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208951d0-9fda-42a7-8191-5fa00093fe03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:45.406920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208951d0-9fda-42a7-8191-5fa00093fe03 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:45.408744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 513/1019] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:45.414241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200eea-7cff-4c07-9cf7-2fab8f8c603f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:45.438580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:45.524863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92200eea-7cff-4c07-9cf7-2fab8f8c603f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:45.559102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d9b53-09f0-4502-a49d-89d4c2945296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:45.559767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9b53-09f0-4502-a49d-89d4c2945296 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:45.560085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9b53-09f0-4502-a49d-89d4c2945296 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:45.560364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9b53-09f0-4502-a49d-89d4c2945296 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:45.561095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9b53-09f0-4502-a49d-89d4c2945296 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:45.562605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9b53-09f0-4502-a49d-89d4c2945296 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:45.673240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 507/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:45 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:46.115508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da43f-85c2-4bd4-bd1d-67ff665398c9 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.115920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da43f-85c2-4bd4-bd1d-67ff665398c9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.116104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da43f-85c2-4bd4-bd1d-67ff665398c9 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.117603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 514/1021] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:46.122536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11896689-20fc-415c-83f3-8e0f33151f9c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.122828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11896689-20fc-415c-83f3-8e0f33151f9c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.123633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11896689-20fc-415c-83f3-8e0f33151f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.141474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-11896689-20fc-415c-83f3-8e0f33151f9c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:46.142653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11896689-20fc-415c-83f3-8e0f33151f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:46.213399 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 508/1022] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:46.235754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da43f-85c2-4bd4-bd1d-67ff665398c9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:46.339114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da43f-85c2-4bd4-bd1d-67ff665398c9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:46.372854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:46.373591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.373871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.374144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] PATH_INFO: `/v3/services/image` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.374795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:46.376186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:46.377982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:46.389293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:46.393795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:46.394833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 515/1023] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jun 15 00:23:46 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:46.398262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11896689-20fc-415c-83f3-8e0f33151f9c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:46.400371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:46.497753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11896689-20fc-415c-83f3-8e0f33151f9c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:46.532286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:46.532948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.533233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.533509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.534210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] RBAC: Adding query filter params (name=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:46.534518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:46.535877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:46.540869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 509/1024] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:46.546465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:46.646621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af7c6a-136f-498f-9845-c61e4914ae66 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:46.678680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:46.679332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.679615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.679890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.680614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:46.680920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:46.682284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:46.687772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 516/1025] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:46.693509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:46.766656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:46.801255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8f9ad-82dd-4d0a-95f8-fb276309f644 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:46.836890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdee2f2-930e-4a4a-9af2-dfc0325cde50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:46.837579 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee2f2-930e-4a4a-9af2-dfc0325cde50 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.837865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee2f2-930e-4a4a-9af2-dfc0325cde50 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.838277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee2f2-930e-4a4a-9af2-dfc0325cde50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.838938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdee2f2-930e-4a4a-9af2-dfc0325cde50 None admin] RBAC: Adding query filter params (interface=public, service_id=38a51087dd9440858e41ed8283ba3c0e, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:46.839253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdee2f2-930e-4a4a-9af2-dfc0325cde50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:46.840650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdee2f2-930e-4a4a-9af2-dfc0325cde50 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:46.845893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 510/1026] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:46 2022] GET /identity/v3/endpoints?service_id=38a51087dd9440858e41ed8283ba3c0e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:46.851864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:46.916473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:46.957613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd232a-b268-451f-863f-cf730195cfc3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:46.992392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9df3-8501-445e-8abb-d85faef26769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:46.993051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9df3-8501-445e-8abb-d85faef26769 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.993329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9df3-8501-445e-8abb-d85faef26769 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.993598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9df3-8501-445e-8abb-d85faef26769 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.994268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b9df3-8501-445e-8abb-d85faef26769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:46.995624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b9df3-8501-445e-8abb-d85faef26769 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:47.008410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 517/1027] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:46 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:23:47.315934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13621174-4ad5-4d96-a409-b013e0664228 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:47.316310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13621174-4ad5-4d96-a409-b013e0664228 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:47.316526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13621174-4ad5-4d96-a409-b013e0664228 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:47.318044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 511/1028] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:47.323021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5cde9-596b-4d75-ab2c-6b9be24f4fb6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:47.323312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5cde9-596b-4d75-ab2c-6b9be24f4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:47.323587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5cde9-596b-4d75-ab2c-6b9be24f4fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:47.340484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-aad5cde9-596b-4d75-ab2c-6b9be24f4fb6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:47.342202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aad5cde9-596b-4d75-ab2c-6b9be24f4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:47.410435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 518/1029] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:47.433907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13621174-4ad5-4d96-a409-b013e0664228 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:47.539549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13621174-4ad5-4d96-a409-b013e0664228 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:47.570974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:47.576182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f012dcd-0ee2-4b00-81f6-f5ad18fe36c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:47.577285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f012dcd-0ee2-4b00-81f6-f5ad18fe36c5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:47.577757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f012dcd-0ee2-4b00-81f6-f5ad18fe36c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:47.588137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f012dcd-0ee2-4b00-81f6-f5ad18fe36c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:47.588248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f012dcd-0ee2-4b00-81f6-f5ad18fe36c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4f012dcd-0ee2-4b00-81f6-f5ad18fe36c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:47.596883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:47.597796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:47.598766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 512/1030] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:47.604049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5cde9-596b-4d75-ab2c-6b9be24f4fb6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:47.661228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:47.704884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5cde9-596b-4d75-ab2c-6b9be24f4fb6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:47.746838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdddd9-0ab8-40c1-8d3e-4f9ab11bb55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:47.747505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdddd9-0ab8-40c1-8d3e-4f9ab11bb55a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:47.747786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdddd9-0ab8-40c1-8d3e-4f9ab11bb55a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:47.748646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdddd9-0ab8-40c1-8d3e-4f9ab11bb55a None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:47.749397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdddd9-0ab8-40c1-8d3e-4f9ab11bb55a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:47.749701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdddd9-0ab8-40c1-8d3e-4f9ab11bb55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:47.751051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdddd9-0ab8-40c1-8d3e-4f9ab11bb55a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:47.763936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 519/1031] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:47.765389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f012dcd-0ee2-4b00-81f6-f5ad18fe36c5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:47.854776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc194-58b0-4bfe-835f-893532cfa70f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:47.855072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc194-58b0-4bfe-835f-893532cfa70f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:47.855254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccc194-58b0-4bfe-835f-893532cfa70f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:47.856634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 520/1032] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:47.861331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10472816-bca6-4bd8-a5e5-b89b4b64f86c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:47.861616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10472816-bca6-4bd8-a5e5-b89b4b64f86c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:47.861895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10472816-bca6-4bd8-a5e5-b89b4b64f86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:47.875721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f012dcd-0ee2-4b00-81f6-f5ad18fe36c5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:47.878081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-10472816-bca6-4bd8-a5e5-b89b4b64f86c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:47.879253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-10472816-bca6-4bd8-a5e5-b89b4b64f86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:47.912083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:47.912867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:47.913146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:47.913417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:47.926336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:47.928422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:47.945029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:47.945911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:47.946786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:47.946786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:47.946786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:47.946786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:47.946786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 513/1033] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:47.951951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 521/1034] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:47.952413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:47.974313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10472816-bca6-4bd8-a5e5-b89b4b64f86c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:48.002202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:48.024971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:48.065228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc492970-afbd-41fb-9a07-ac764e956d3c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:48.082641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10472816-bca6-4bd8-a5e5-b89b4b64f86c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:48.104952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:48.105649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.105934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.106213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.106935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:48.107273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:48.108882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:48.118996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29b6ce-8831-41de-b52f-eaf8951a81ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:48.119785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29b6ce-8831-41de-b52f-eaf8951a81ca None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.120093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29b6ce-8831-41de-b52f-eaf8951a81ca None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.120408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29b6ce-8831-41de-b52f-eaf8951a81ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.121553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29b6ce-8831-41de-b52f-eaf8951a81ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:48.123950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29b6ce-8831-41de-b52f-eaf8951a81ca None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:48.129706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 522/1035] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:48.129836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 514/1036] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:48.129917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29b6ce-8831-41de-b52f-eaf8951a81ca None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:48.130526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:48.233453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c8d77-8260-446a-87c0-d8790aa7d399 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:48.236522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:48.238338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29b6ce-8831-41de-b52f-eaf8951a81ca None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:48.255523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:48.270982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b69f-76f6-44a8-930c-8faf971331a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:48.271655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b69f-76f6-44a8-930c-8faf971331a9 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.271965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b69f-76f6-44a8-930c-8faf971331a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.272246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b69f-76f6-44a8-930c-8faf971331a9 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.272953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14b69f-76f6-44a8-930c-8faf971331a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:48.274370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14b69f-76f6-44a8-930c-8faf971331a9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:48.274604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:48.275382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.275660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.275949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.285676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:48.287103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:48.302778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:48.303773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:48.305355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 523/1037] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:48.309545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:48.380181 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 515/1038] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:23:48 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:48.414300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588decba-eafe-45b3-8032-0d0249a38ba5 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:48.452908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:48.453588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.453864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.454133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.454980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:48.455285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:48.456755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:48.481154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 524/1039] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:48.483099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b69f-76f6-44a8-930c-8faf971331a9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:48.591433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b69f-76f6-44a8-930c-8faf971331a9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:48.626566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59437ea6-e2fe-40c2-9318-cf9132baee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:48.627219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59437ea6-e2fe-40c2-9318-cf9132baee59 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.627498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59437ea6-e2fe-40c2-9318-cf9132baee59 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.627772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59437ea6-e2fe-40c2-9318-cf9132baee59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.656804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:48.696400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59437ea6-e2fe-40c2-9318-cf9132baee59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:48.697924 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59437ea6-e2fe-40c2-9318-cf9132baee59 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:48.807945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 516/1040] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:48 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:48.809137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:48.842814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:48.909046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a20a2-4997-4cc5-a76a-70338068ee0b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:48.944993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1f65-b154-4844-aa30-f1e94da7202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:48.945788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1f65-b154-4844-aa30-f1e94da7202e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.946069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1f65-b154-4844-aa30-f1e94da7202e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.946341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1f65-b154-4844-aa30-f1e94da7202e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.956683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1f65-b154-4844-aa30-f1e94da7202e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:48.958120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1f65-b154-4844-aa30-f1e94da7202e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-d82b1f65-b154-4844-aa30-f1e94da7202e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:48.976015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:48.977022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:48.983176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:48.983176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:48.983176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:48.983176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:48.983176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 525/1041] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:48.983461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59437ea6-e2fe-40c2-9318-cf9132baee59 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.042985 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:49.087289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59437ea6-e2fe-40c2-9318-cf9132baee59 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.125054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.125716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.125995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.126265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.126973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:49.127276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.128715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:49.145356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 517/1042] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:49.145562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1617d-3947-4d9e-9813-3ba910c35902 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.145562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1617d-3947-4d9e-9813-3ba910c35902 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.145562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1617d-3947-4d9e-9813-3ba910c35902 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.145562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 526/1043] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:49.146996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.148811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ff27-3328-4d81-a787-56e0b83284e0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.149103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ff27-3328-4d81-a787-56e0b83284e0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.149383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ff27-3328-4d81-a787-56e0b83284e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.166262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0ac4ff27-3328-4d81-a787-56e0b83284e0 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:49.167381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0ac4ff27-3328-4d81-a787-56e0b83284e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:49.244266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 527/1044] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:49.252295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b300a-784e-4fa1-818f-f037098497a4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.257039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4ff27-3328-4d81-a787-56e0b83284e0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.275436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:49.275580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:49.298964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.323385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.323385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.323385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.323385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.323385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:49.323385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:49.323385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:49.329459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:49.330422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:49.331581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:49.331581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:49.331581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:49.331581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:49.331581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:49.331581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 518/1045] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:49.331581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.365908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4ff27-3328-4d81-a787-56e0b83284e0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.400806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.401581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.401863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.402133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] PATH_INFO: `/v3/services/image` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.402779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.404748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:49.416178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:49.417709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:49.418569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 528/1046] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jun 15 00:23:49 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:49.423363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.437578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee226-3173-47b7-b2e1-d56d3b7f464a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.475828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.476533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.476819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.477320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.477877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:49.478189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.479605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:49.491607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 519/1047] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:49.497626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.513219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:49.537003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfa709-4254-4deb-b117-59c6f49eca4a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.542273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:49.573702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.574370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.574652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.574928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.575636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:49.576525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.577906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:49.583165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 529/1048] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:49.588398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.608802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fed90-582b-43f4-a5af-e120f8ca08ed None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.645897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.646557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.646842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.647121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.647993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] RBAC: Adding query filter params (role.id=5192b499fc6b422b87abb6329aaa5ab4, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=ad41d031778c4e8ebc8c176c3670f4b2) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:49.648287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.649710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:49.655820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 520/1049] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:49 2022] GET /identity/v3/role_assignments?user.id=ad41d031778c4e8ebc8c176c3670f4b2&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5192b499fc6b422b87abb6329aaa5ab4 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:49.709951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822907e-bbbf-47aa-8bb7-de62d132a4c4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.753185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6b450-4cbb-48a6-bb74-b2263076d354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.753865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b450-4cbb-48a6-bb74-b2263076d354 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.754149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b450-4cbb-48a6-bb74-b2263076d354 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.754425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6b450-4cbb-48a6-bb74-b2263076d354 None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.755148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6b450-4cbb-48a6-bb74-b2263076d354 None admin] RBAC: Adding query filter params (type=image) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:49.755455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6b450-4cbb-48a6-bb74-b2263076d354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.756879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6b450-4cbb-48a6-bb74-b2263076d354 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:49.768150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 530/1050] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:49.769203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.878731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a8d7-cb13-4ea9-a1b5-3316dc60f5a0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.881869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:49.916634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7c2c0-f7b2-4208-a496-b3901146b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.917299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7c2c0-f7b2-4208-a496-b3901146b100 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.917584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7c2c0-f7b2-4208-a496-b3901146b100 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.917863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7c2c0-f7b2-4208-a496-b3901146b100 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.918598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7c2c0-f7b2-4208-a496-b3901146b100 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.920045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7c2c0-f7b2-4208-a496-b3901146b100 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:50.036059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 521/1051] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:50.568568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd295f-718f-450a-821f-903cc593e118 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:50.569102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd295f-718f-450a-821f-903cc593e118 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:50.569102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd295f-718f-450a-821f-903cc593e118 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:50.570619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 531/1052] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:50.575528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d19b-e190-453a-b013-d000effeba6c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:50.575855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d19b-e190-453a-b013-d000effeba6c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:50.576172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d19b-e190-453a-b013-d000effeba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:50.593014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7018d19b-e190-453a-b013-d000effeba6c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:50.594198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7018d19b-e190-453a-b013-d000effeba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:50.668175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 522/1053] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:50.691351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd295f-718f-450a-821f-903cc593e118 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:50.703233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:50.801075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd295f-718f-450a-821f-903cc593e118 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:50.834447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236046ca-a075-4b80-96e5-4e746055da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:50.835210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236046ca-a075-4b80-96e5-4e746055da99 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:50.835491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236046ca-a075-4b80-96e5-4e746055da99 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:50.835782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236046ca-a075-4b80-96e5-4e746055da99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:50.847024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236046ca-a075-4b80-96e5-4e746055da99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-236046ca-a075-4b80-96e5-4e746055da99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:50.854533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:50.855444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:50.856336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:50.860234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 532/1054] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:50.861655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018d19b-e190-453a-b013-d000effeba6c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:50.943415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:50.959021 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018d19b-e190-453a-b013-d000effeba6c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:50.992833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:50.993735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:50.994206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:50.994648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:50.995649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:50.996267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:50.997837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:51.006822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 523/1055] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:51.012571 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236046ca-a075-4b80-96e5-4e746055da99 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:51.083246 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:51.117354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236046ca-a075-4b80-96e5-4e746055da99 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:51.154009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7f89-c2f9-4835-b83c-05c0cb18b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:51.154876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7f89-c2f9-4835-b83c-05c0cb18b557 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.155162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7f89-c2f9-4835-b83c-05c0cb18b557 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.155463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7f89-c2f9-4835-b83c-05c0cb18b557 None admin] PATH_INFO: `/v3/users/33e6ca76224244818b265efc9e82f14b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.168937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc7f89-c2f9-4835-b83c-05c0cb18b557 None admin] RBAC: Authorizing `identity:get_user(user_id=33e6ca76224244818b265efc9e82f14b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:51.170424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc7f89-c2f9-4835-b83c-05c0cb18b557 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:51.172355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 533/1056] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:51 2022] GET /identity/v3/users/33e6ca76224244818b265efc9e82f14b => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:51.177849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:51.281502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f700-d213-4eef-b447-4ee33195ebee None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:51.314663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cbd36-43a6-4a1f-bdf7-09be21edf8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:51.315315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cbd36-43a6-4a1f-bdf7-09be21edf8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.315600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cbd36-43a6-4a1f-bdf7-09be21edf8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.315879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cbd36-43a6-4a1f-bdf7-09be21edf8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.333937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:51.384076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cbd36-43a6-4a1f-bdf7-09be21edf8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:51.385442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cbd36-43a6-4a1f-bdf7-09be21edf8e7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:51.482973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 524/1057] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:51.488587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7f89-c2f9-4835-b83c-05c0cb18b557 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:51.587977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7f89-c2f9-4835-b83c-05c0cb18b557 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:51.614324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:51.623300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c946771-7a4b-41ae-a060-2467d2198408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:51.624200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c946771-7a4b-41ae-a060-2467d2198408 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.624485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c946771-7a4b-41ae-a060-2467d2198408 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.624758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c946771-7a4b-41ae-a060-2467d2198408 None admin] PATH_INFO: `/v3/projects/7aeda51ceb91490690bfdb33edeb29ca` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.625948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c946771-7a4b-41ae-a060-2467d2198408 None admin] RBAC: Authorizing `identity:get_project(project_id=7aeda51ceb91490690bfdb33edeb29ca)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:51.627381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c946771-7a4b-41ae-a060-2467d2198408 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:51.639010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 534/1058] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:51 2022] GET /identity/v3/projects/7aeda51ceb91490690bfdb33edeb29ca => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:51.639154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cbd36-43a6-4a1f-bdf7-09be21edf8e7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:51.685740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:51.748869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cbd36-43a6-4a1f-bdf7-09be21edf8e7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:51.774405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6e22-81a2-4e23-9790-4febb4cb04a5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.774695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6e22-81a2-4e23-9790-4febb4cb04a5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.774974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6e22-81a2-4e23-9790-4febb4cb04a5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.776394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 535/1059] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:51.781862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed896d-be95-48ec-9f81-9a5b5a663c89 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.782161 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed896d-be95-48ec-9f81-9a5b5a663c89 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.782443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed896d-be95-48ec-9f81-9a5b5a663c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.787866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:51.789382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.789665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.789941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.790770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=7aeda51ceb91490690bfdb33edeb29ca, user.id=33e6ca76224244818b265efc9e82f14b) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:51.791085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:51.792540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:51.798912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 525/1060] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:51 2022] GET /identity/v3/role_assignments?user.id=33e6ca76224244818b265efc9e82f14b&scope.project.id=7aeda51ceb91490690bfdb33edeb29ca&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:51.805702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fbed896d-be95-48ec-9f81-9a5b5a663c89 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:51.807146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fbed896d-be95-48ec-9f81-9a5b5a663c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:51.886084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 536/1061] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:51.909707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.016998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed00a1-8884-4f73-a9fb-95d5f9aa397e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.031732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:52.054036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1c5ce-1307-4152-9429-36795278be41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.054850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1c5ce-1307-4152-9429-36795278be41 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.055132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1c5ce-1307-4152-9429-36795278be41 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.055408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1c5ce-1307-4152-9429-36795278be41 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.065947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1c5ce-1307-4152-9429-36795278be41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7ba1c5ce-1307-4152-9429-36795278be41 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:52.074125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:52.075103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:52.076556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 526/1062] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:52.083728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed896d-be95-48ec-9f81-9a5b5a663c89 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.173697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae5447-0e3c-4332-aee6-02313c225043 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.173915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae5447-0e3c-4332-aee6-02313c225043 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.174196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae5447-0e3c-4332-aee6-02313c225043 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.175557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 527/1063] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:52.180258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b65a1-c2d7-4882-8274-13a70d03b632 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.180542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b65a1-c2d7-4882-8274-13a70d03b632 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.180819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b65a1-c2d7-4882-8274-13a70d03b632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.191090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed896d-be95-48ec-9f81-9a5b5a663c89 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.199365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0c3b65a1-c2d7-4882-8274-13a70d03b632 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:52.200598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0c3b65a1-c2d7-4882-8274-13a70d03b632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:52.216933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:52.228204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.228875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.229155 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.229433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.230240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:52.230547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:52.232492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:52.245202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 537/1064] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:52.246217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.276369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 528/1065] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:52.298905 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b65a1-c2d7-4882-8274-13a70d03b632 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.356507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6c638-41ee-4724-9a32-b7be7d507b5d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.393101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.394156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.394625 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.395060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.399513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b65a1-c2d7-4882-8274-13a70d03b632 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.401185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:52.406272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:52.407734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:52.426055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:52.427204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:52.428507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:52.428507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:52.428507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:52.428507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:52.428507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 538/1066] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:52.433081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.440694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824305a-bb91-4c8e-9c7d-e6ed9926674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.441352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824305a-bb91-4c8e-9c7d-e6ed9926674d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.441636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824305a-bb91-4c8e-9c7d-e6ed9926674d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.441914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824305a-bb91-4c8e-9c7d-e6ed9926674d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.474029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:52.514269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824305a-bb91-4c8e-9c7d-e6ed9926674d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:52.515718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824305a-bb91-4c8e-9c7d-e6ed9926674d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:52.538322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213f06-8be7-4dd0-bb48-855a3b666cf8 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.572482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.573140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.573421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.573688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.574462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:52.574765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:52.576222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:52.593929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 539/1067] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:52.595520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.635944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 529/1068] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:23:52.639238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824305a-bb91-4c8e-9c7d-e6ed9926674d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.641103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:52.695359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:52.699962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7814d-691c-4e0f-972f-cfab90c059f6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.739862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.740771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.741056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.741338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.747436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824305a-bb91-4c8e-9c7d-e6ed9926674d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.748747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:52.750193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:52.765626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:52.766563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:52.767504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:52.771636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 540/1069] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:52.772503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.784117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.784926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.785179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.785458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.796520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:52.798001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:52.817872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:52.818797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:52.819685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:52.819685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:52.819685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:52.819685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:52.819685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 530/1070] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:52.824732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.879579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a1877-ad27-44e3-b380-7265ba0136d0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.888616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:52.915309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.916260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.916692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.917372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.917989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:52.918297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:52.920372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:52.938315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48a15-90d0-4317-8573-cec2d590acd4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:52.942329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 541/1071] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:52.947826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:52.968168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:52.976532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:52.977252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:52.977540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:52.978008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:52.978515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:52.978823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:52.980195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:52.992136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 531/1072] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:53.056617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85538b6e-3799-4ef8-bbed-c8ccc77d4cf1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:53.094242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:53.095048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:53.095329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:53.095599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:53.107004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:53.108512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:53.127351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:53.128579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:53.129474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:53.129474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:53.129474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:53.129474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:53.129474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 542/1073] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:53.136036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:53.248562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fddff-a59f-49d2-bb58-18f9c9fa6704 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:53.262627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:53.283355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:53.284054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:53.284333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:53.284601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:53.285309 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:53.285612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:53.286995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:53.300078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 532/1074] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:53.304531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:53.369462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:53.401851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07426e5-b636-4877-8345-4f45e2da1c2d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:53.434782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:53.436108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:53.436383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:53.436650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:53.443102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:53.444562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:53.458304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:53.459192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:53.460126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 543/1075] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:53.465315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:53.564251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70528b-9f5f-4dc4-a55a-715d3082e0e3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:53.597091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f121b6-3e2f-41cc-b5bd-f3cafaf07212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:53.597749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f121b6-3e2f-41cc-b5bd-f3cafaf07212 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:53.598030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f121b6-3e2f-41cc-b5bd-f3cafaf07212 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:53.598306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f121b6-3e2f-41cc-b5bd-f3cafaf07212 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:53.599101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f121b6-3e2f-41cc-b5bd-f3cafaf07212 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:53.599394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f121b6-3e2f-41cc-b5bd-f3cafaf07212 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:53.600844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f121b6-3e2f-41cc-b5bd-f3cafaf07212 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:53.612075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 533/1076] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:53.617913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:53.715587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b41a9b-d913-4ca8-bff2-2975f8e8d2e4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:53.742531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:53.751053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a0e7b-a605-43c9-8d6b-db551c297966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:53.755142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a0e7b-a605-43c9-8d6b-db551c297966 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:53.755142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a0e7b-a605-43c9-8d6b-db551c297966 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:53.755142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a0e7b-a605-43c9-8d6b-db551c297966 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/ad41d031778c4e8ebc8c176c3670f4b2/roles/5192b499fc6b422b87abb6329aaa5ab4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:53.755142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a0e7b-a605-43c9-8d6b-db551c297966 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=ad41d031778c4e8ebc8c176c3670f4b2, role_id=5192b499fc6b422b87abb6329aaa5ab4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:53.756154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a0e7b-a605-43c9-8d6b-db551c297966 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:53.846899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 544/1077] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:53 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/ad41d031778c4e8ebc8c176c3670f4b2/roles/5192b499fc6b422b87abb6329aaa5ab4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:23:53.938586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e8f45-7483-4cf4-9252-6dc344ea65e2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:53.938880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e8f45-7483-4cf4-9252-6dc344ea65e2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:53.939164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e8f45-7483-4cf4-9252-6dc344ea65e2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:53.940583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 534/1078] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:53.946394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40b7b-e83c-46f0-a367-15ae7466e436 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:53.946691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40b7b-e83c-46f0-a367-15ae7466e436 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:53.946971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40b7b-e83c-46f0-a367-15ae7466e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:53.964226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d8b40b7b-e83c-46f0-a367-15ae7466e436 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:53.965442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d8b40b7b-e83c-46f0-a367-15ae7466e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:54.037646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 545/1079] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:54.060593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e8f45-7483-4cf4-9252-6dc344ea65e2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:54.095576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:54.163575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e8f45-7483-4cf4-9252-6dc344ea65e2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:54.197784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff6f59-819f-4847-9439-65e4cd07cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:54.198574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff6f59-819f-4847-9439-65e4cd07cc1e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.198855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff6f59-819f-4847-9439-65e4cd07cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.199129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff6f59-819f-4847-9439-65e4cd07cc1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.210534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff6f59-819f-4847-9439-65e4cd07cc1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b9ff6f59-819f-4847-9439-65e4cd07cc1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:54.218173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:54.219281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:54.220173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 535/1080] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:54.225580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b40b7b-e83c-46f0-a367-15ae7466e436 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:54.321233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b40b7b-e83c-46f0-a367-15ae7466e436 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:54.338512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:54.354617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:54.355265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.355543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.355811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.356581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:54.356907 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:54.358259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:54.366054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 546/1081] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:54.371775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff6f59-819f-4847-9439-65e4cd07cc1e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:54.462952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:54.469348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff6f59-819f-4847-9439-65e4cd07cc1e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:54.503378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b82f14-4c2b-4581-bd69-7aa40b1d4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:54.504272 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82f14-4c2b-4581-bd69-7aa40b1d4c8f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.504552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82f14-4c2b-4581-bd69-7aa40b1d4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.504824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b82f14-4c2b-4581-bd69-7aa40b1d4c8f None admin] PATH_INFO: `/v3/users/33e6ca76224244818b265efc9e82f14b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.506016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b82f14-4c2b-4581-bd69-7aa40b1d4c8f None admin] RBAC: Authorizing `identity:get_user(user_id=33e6ca76224244818b265efc9e82f14b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:54.507444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b82f14-4c2b-4581-bd69-7aa40b1d4c8f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:54.509354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 536/1082] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:54 2022] GET /identity/v3/users/33e6ca76224244818b265efc9e82f14b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:54.515040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:54.611083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480d2f-0067-4692-8ccf-797402f66be7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:54.643805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c10ae8-0ea2-44c0-a6c5-06cd3a421069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:54.644675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10ae8-0ea2-44c0-a6c5-06cd3a421069 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.644950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10ae8-0ea2-44c0-a6c5-06cd3a421069 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.645219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10ae8-0ea2-44c0-a6c5-06cd3a421069 None admin] PATH_INFO: `/v3/projects/7aeda51ceb91490690bfdb33edeb29ca` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.646371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c10ae8-0ea2-44c0-a6c5-06cd3a421069 None admin] RBAC: Authorizing `identity:get_project(project_id=7aeda51ceb91490690bfdb33edeb29ca)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:54.647787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c10ae8-0ea2-44c0-a6c5-06cd3a421069 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:54.649484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 547/1083] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:54 2022] GET /identity/v3/projects/7aeda51ceb91490690bfdb33edeb29ca => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:54.655408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b82f14-4c2b-4581-bd69-7aa40b1d4c8f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:54.756922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b82f14-4c2b-4581-bd69-7aa40b1d4c8f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:54.789109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb7dc1-c4a0-47ec-b53b-693d98470217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:54.789980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7dc1-c4a0-47ec-b53b-693d98470217 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.790258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7dc1-c4a0-47ec-b53b-693d98470217 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.790530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7dc1-c4a0-47ec-b53b-693d98470217 None admin] PATH_INFO: `/v3/projects/7aeda51ceb91490690bfdb33edeb29ca/users/33e6ca76224244818b265efc9e82f14b/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.792480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb7dc1-c4a0-47ec-b53b-693d98470217 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aeda51ceb91490690bfdb33edeb29ca, user_id=33e6ca76224244818b265efc9e82f14b, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:54.793897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb7dc1-c4a0-47ec-b53b-693d98470217 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:54.870429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 537/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:54 2022] PUT /identity/v3/projects/7aeda51ceb91490690bfdb33edeb29ca/users/33e6ca76224244818b265efc9e82f14b/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:23:55.978755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c836-8544-4402-a704-847885b3eeae None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:55.979298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c836-8544-4402-a704-847885b3eeae None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:55.979298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c836-8544-4402-a704-847885b3eeae None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:55.980720 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 548/1085] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:55.985984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8ff9-aa7e-4e62-819f-0cfbdae4408a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:55.986397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8ff9-aa7e-4e62-819f-0cfbdae4408a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:55.986535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8ff9-aa7e-4e62-819f-0cfbdae4408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.004068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-25ae8ff9-aa7e-4e62-819f-0cfbdae4408a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:56.005114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-25ae8ff9-aa7e-4e62-819f-0cfbdae4408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:56.022222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:56.072103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 538/1086] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:56.096201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c836-8544-4402-a704-847885b3eeae None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:56.144973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:56.195029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c836-8544-4402-a704-847885b3eeae None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:56.227219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436b0dd-89c1-42fe-be20-649caf525ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:56.228100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436b0dd-89c1-42fe-be20-649caf525ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.228379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436b0dd-89c1-42fe-be20-649caf525ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.228648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436b0dd-89c1-42fe-be20-649caf525ed3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.238825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436b0dd-89c1-42fe-be20-649caf525ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7436b0dd-89c1-42fe-be20-649caf525ed3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:56.246803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:56.247693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:56.248731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 549/1087] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:56.253892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae8ff9-aa7e-4e62-819f-0cfbdae4408a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:56.350803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae8ff9-aa7e-4e62-819f-0cfbdae4408a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:56.383280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:56.384225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.384506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.384778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.385518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:56.385821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:56.387170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:56.395542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 539/1088] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:56.401241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436b0dd-89c1-42fe-be20-649caf525ed3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:56.495864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436b0dd-89c1-42fe-be20-649caf525ed3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:56.505334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:56.529451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:56.530225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.530503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.530774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.540874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:56.542305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:56.559140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:56.560542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:56.561593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:56.561593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:56.561593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:56.561593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:56.561593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 550/1089] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:56.567352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:56.583709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:56.664523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63d5fb-dd6f-4950-9471-7bfc4afcf5c8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:56.696219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:56.696867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.697144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.697416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.698122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:56.698425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:56.699771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:56.711647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 540/1090] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:56.718276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:56.815925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17039173-3d9d-4c46-bc08-3a6a807788b7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:56.847107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec53ed-b5ff-4974-8284-b67c0c09a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:56.847876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec53ed-b5ff-4974-8284-b67c0c09a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.848184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec53ed-b5ff-4974-8284-b67c0c09a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.848452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec53ed-b5ff-4974-8284-b67c0c09a4a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.855638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec53ed-b5ff-4974-8284-b67c0c09a4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:56.857642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec53ed-b5ff-4974-8284-b67c0c09a4a1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-77ec53ed-b5ff-4974-8284-b67c0c09a4a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:56.871058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:56.872211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:56.874043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 551/1091] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:56.878664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:56.955652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:56.967992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2e97-7524-4d26-bebd-ae40d89b0157 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.976932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2e97-7524-4d26-bebd-ae40d89b0157 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.976932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed2e97-7524-4d26-bebd-ae40d89b0157 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.976932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 552/1092] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:56.976932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d32aa-b692-46d3-a4e2-63ccc82bf7f9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.976932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d32aa-b692-46d3-a4e2-63ccc82bf7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.976932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d32aa-b692-46d3-a4e2-63ccc82bf7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.980135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800bc98-ef1a-404d-9466-a8ecbf2e105d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:56.992348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ec3d32aa-b692-46d3-a4e2-63ccc82bf7f9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:56.993526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ec3d32aa-b692-46d3-a4e2-63ccc82bf7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:57.007819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.014851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.015516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.015795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.016971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.016971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:57.017236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.018634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.035668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 541/1093] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:57.040716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.061426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 553/1094] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:57.084285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d32aa-b692-46d3-a4e2-63ccc82bf7f9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.136793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff2c04-4b63-4f9a-9728-cd4c47e929a5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.165120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.170563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39daf-32d2-4471-b9d2-5f59e3414073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.171244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39daf-32d2-4471-b9d2-5f59e3414073 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.177320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39daf-32d2-4471-b9d2-5f59e3414073 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.177320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39daf-32d2-4471-b9d2-5f59e3414073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.179406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d32aa-b692-46d3-a4e2-63ccc82bf7f9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.211889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0c95-445b-42bf-8e9a-b5773db5ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.212620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0c95-445b-42bf-8e9a-b5773db5ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.212898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0c95-445b-42bf-8e9a-b5773db5ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.213168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0c95-445b-42bf-8e9a-b5773db5ed4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.223525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b0c95-445b-42bf-8e9a-b5773db5ed4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-968b0c95-445b-42bf-8e9a-b5773db5ed4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:57.231010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:57.232517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:23:57.233587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 554/1095] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:57.238602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0c95-445b-42bf-8e9a-b5773db5ed4a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.239749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39daf-32d2-4471-b9d2-5f59e3414073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.241231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39daf-32d2-4471-b9d2-5f59e3414073 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.251083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.337257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0c95-445b-42bf-8e9a-b5773db5ed4a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.341833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 542/1096] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:23:57.347448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39daf-32d2-4471-b9d2-5f59e3414073 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.372994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.373653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.373935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.374211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.374955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:57.375263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.376324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.376657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.385547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 555/1097] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:57.391839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.444114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39daf-32d2-4471-b9d2-5f59e3414073 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.460778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.478066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.478786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.479063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.479333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.489345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3240-08e9-40ca-921c-44238dcb68bc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.489945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.491393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:57.509339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:57.510388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:57.511343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:57.511343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:57.511343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:57.511343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:57.511343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 543/1098] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:57.516247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.524079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822f66-fc69-46ad-b6ec-e421fd30d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.525021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822f66-fc69-46ad-b6ec-e421fd30d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.525300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822f66-fc69-46ad-b6ec-e421fd30d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.525569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822f66-fc69-46ad-b6ec-e421fd30d7b3 None admin] PATH_INFO: `/v3/users/33e6ca76224244818b265efc9e82f14b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.526746 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a822f66-fc69-46ad-b6ec-e421fd30d7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=33e6ca76224244818b265efc9e82f14b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.528189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a822f66-fc69-46ad-b6ec-e421fd30d7b3 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.529903 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 556/1099] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/users/33e6ca76224244818b265efc9e82f14b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:57.535328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822f66-fc69-46ad-b6ec-e421fd30d7b3 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.598887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.614673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100dd903-d28d-4c5f-bef6-ba439bebce98 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.632134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822f66-fc69-46ad-b6ec-e421fd30d7b3 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.649606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.650255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.650537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.650809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.651527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:57.651827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.653228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.664323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 544/1100] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:57.664649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b31c9-ea94-49c8-afb8-a3fb5a693a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.665347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b31c9-ea94-49c8-afb8-a3fb5a693a80 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.665639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b31c9-ea94-49c8-afb8-a3fb5a693a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.665915 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b31c9-ea94-49c8-afb8-a3fb5a693a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.670399 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.677588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.737785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b31c9-ea94-49c8-afb8-a3fb5a693a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.739176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b31c9-ea94-49c8-afb8-a3fb5a693a80 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.768398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18422b-5fa8-44c5-9e13-1186f7aeadf8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.800801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.801577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.801850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.802120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.808550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.810499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:57.824680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:57.825609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:23:57.826496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 545/1101] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:57.831624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.834886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.840286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 557/1102] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:23:57.846301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b31c9-ea94-49c8-afb8-a3fb5a693a80 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.886198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.931039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011614c0-5d39-4d52-8236-91cdeeb514f7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.942578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b31c9-ea94-49c8-afb8-a3fb5a693a80 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.964453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.965100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.965379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.965652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.966946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:57.967250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.968695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.976224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9a0dc-592e-4546-b6a3-0881f81f11f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.977058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a0dc-592e-4546-b6a3-0881f81f11f9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.977337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a0dc-592e-4546-b6a3-0881f81f11f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.977608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9a0dc-592e-4546-b6a3-0881f81f11f9 None admin] PATH_INFO: `/v3/projects/7aeda51ceb91490690bfdb33edeb29ca` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.978774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9a0dc-592e-4546-b6a3-0881f81f11f9 None admin] RBAC: Authorizing `identity:get_project(project_id=7aeda51ceb91490690bfdb33edeb29ca)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.979762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 546/1103] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:57.980206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9a0dc-592e-4546-b6a3-0881f81f11f9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.987252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 558/1104] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/projects/7aeda51ceb91490690bfdb33edeb29ca => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:57.987395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.988196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9a0dc-592e-4546-b6a3-0881f81f11f9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:58.048115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:58.085854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a87f4-d71a-43b7-9d01-2bdbfe27bb02 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:58.087329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9a0dc-592e-4546-b6a3-0881f81f11f9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:58.097060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:58.119700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b53d3-5396-47f4-a951-9c54649ba1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:58.120460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b53d3-5396-47f4-a951-9c54649ba1dc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:58.120743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b53d3-5396-47f4-a951-9c54649ba1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:58.120976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73266b2a-181d-4bfa-979c-0c7a89892d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:58.121087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b53d3-5396-47f4-a951-9c54649ba1dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:58.121613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73266b2a-181d-4bfa-979c-0c7a89892d61 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:58.121827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b53d3-5396-47f4-a951-9c54649ba1dc None admin] RBAC: Adding query filter params (role.id=5192b499fc6b422b87abb6329aaa5ab4, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=ad41d031778c4e8ebc8c176c3670f4b2) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:58.121929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73266b2a-181d-4bfa-979c-0c7a89892d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:58.122142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b53d3-5396-47f4-a951-9c54649ba1dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:58.122244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73266b2a-181d-4bfa-979c-0c7a89892d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:58.123052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73266b2a-181d-4bfa-979c-0c7a89892d61 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=7aeda51ceb91490690bfdb33edeb29ca, user.id=33e6ca76224244818b265efc9e82f14b) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:58.123360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73266b2a-181d-4bfa-979c-0c7a89892d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:58.123567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b53d3-5396-47f4-a951-9c54649ba1dc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:58.124791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73266b2a-181d-4bfa-979c-0c7a89892d61 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:58.136978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 547/1105] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/role_assignments?user.id=ad41d031778c4e8ebc8c176c3670f4b2&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5192b499fc6b422b87abb6329aaa5ab4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:58.137247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 559/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/role_assignments?user.id=33e6ca76224244818b265efc9e82f14b&scope.project.id=7aeda51ceb91490690bfdb33edeb29ca&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:24:00.271665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97f16-2de4-4009-aa7e-94dafedfd206 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.272334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97f16-2de4-4009-aa7e-94dafedfd206 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.272334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff97f16-2de4-4009-aa7e-94dafedfd206 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.273583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 548/1107] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:00.279074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7051a1-e5c7-412e-b62a-dac878d083f2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.279484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7051a1-e5c7-412e-b62a-dac878d083f2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.279627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7051a1-e5c7-412e-b62a-dac878d083f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.296501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2f7051a1-e5c7-412e-b62a-dac878d083f2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:00.297675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2f7051a1-e5c7-412e-b62a-dac878d083f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:00.361173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 560/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:00.385797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff97f16-2de4-4009-aa7e-94dafedfd206 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:00.484879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff97f16-2de4-4009-aa7e-94dafedfd206 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:00.509392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:00.517373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277ee10-5a0f-4852-9ee0-7715a7a0a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:00.531064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277ee10-5a0f-4852-9ee0-7715a7a0a387 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.531064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277ee10-5a0f-4852-9ee0-7715a7a0a387 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.531064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277ee10-5a0f-4852-9ee0-7715a7a0a387 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.531064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277ee10-5a0f-4852-9ee0-7715a7a0a387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:00.531064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277ee10-5a0f-4852-9ee0-7715a7a0a387 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:00.531064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 549/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:24:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:00.531526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7051a1-e5c7-412e-b62a-dac878d083f2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:00.623469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7051a1-e5c7-412e-b62a-dac878d083f2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:00.624967 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:00.657255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855b77a-e930-4c00-bbdc-195a257f4a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:00.657900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b77a-e930-4c00-bbdc-195a257f4a29 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.658176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b77a-e930-4c00-bbdc-195a257f4a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.658445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855b77a-e930-4c00-bbdc-195a257f4a29 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.659150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855b77a-e930-4c00-bbdc-195a257f4a29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:00.660586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855b77a-e930-4c00-bbdc-195a257f4a29 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:00.744500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 561/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:24:00 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:24:02.880321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66d86-e649-49e3-871a-66a3fc6188b6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:02.880906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66d86-e649-49e3-871a-66a3fc6188b6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:02.880906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c66d86-e649-49e3-871a-66a3fc6188b6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:02.882231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 550/1111] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:02.887530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bce1a-12a3-49f5-b75b-de7e6b90ed6f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:02.887960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bce1a-12a3-49f5-b75b-de7e6b90ed6f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:02.888124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bce1a-12a3-49f5-b75b-de7e6b90ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:02.904438 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b03bce1a-12a3-49f5-b75b-de7e6b90ed6f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:02.905621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b03bce1a-12a3-49f5-b75b-de7e6b90ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:02.970262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 562/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:02.994062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c66d86-e649-49e3-871a-66a3fc6188b6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.092557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c66d86-e649-49e3-871a-66a3fc6188b6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.124609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bdbd2-683d-463c-a4a8-4ba160c9fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.125440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bdbd2-683d-463c-a4a8-4ba160c9fa32 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.125720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bdbd2-683d-463c-a4a8-4ba160c9fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.125994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bdbd2-683d-463c-a4a8-4ba160c9fa32 None admin] PATH_INFO: `/v3/roles/414930bf02ef4277b0b66bc57f1f1628` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.127469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bdbd2-683d-463c-a4a8-4ba160c9fa32 None admin] RBAC: Authorizing `identity:get_role(role_id=414930bf02ef4277b0b66bc57f1f1628)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:03.128840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bdbd2-683d-463c-a4a8-4ba160c9fa32 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:03.130175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 551/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:02 2022] GET /identity/v3/roles/414930bf02ef4277b0b66bc57f1f1628 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:03.136186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bce1a-12a3-49f5-b75b-de7e6b90ed6f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.220943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:03.233115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bce1a-12a3-49f5-b75b-de7e6b90ed6f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.265601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2a1e6-e912-4580-90e6-90e60d6dfebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.266444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a1e6-e912-4580-90e6-90e60d6dfebf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.267040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a1e6-e912-4580-90e6-90e60d6dfebf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.267364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a1e6-e912-4580-90e6-90e60d6dfebf None admin] PATH_INFO: `/v3/users/d8f82883152f4989a3b106d06eccbfda` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.280567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2a1e6-e912-4580-90e6-90e60d6dfebf None admin] RBAC: Authorizing `identity:get_user(user_id=d8f82883152f4989a3b106d06eccbfda)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:03.281996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2a1e6-e912-4580-90e6-90e60d6dfebf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:03.283606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 563/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:03 2022] GET /identity/v3/users/d8f82883152f4989a3b106d06eccbfda => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:03.289555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bdbd2-683d-463c-a4a8-4ba160c9fa32 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.350268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:03.387465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bdbd2-683d-463c-a4a8-4ba160c9fa32 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.420533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e505-c55c-47b9-b113-643183c313dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.421167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e505-c55c-47b9-b113-643183c313dd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.421450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e505-c55c-47b9-b113-643183c313dd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.421726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e505-c55c-47b9-b113-643183c313dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.486519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1e505-c55c-47b9-b113-643183c313dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:03.487987 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1e505-c55c-47b9-b113-643183c313dd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:03.547716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:03.585179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 552/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:24:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:24:03.591879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2a1e6-e912-4580-90e6-90e60d6dfebf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.686572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2a1e6-e912-4580-90e6-90e60d6dfebf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.719096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd56d4-dd67-43f7-8622-abf604bb94d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.719954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd56d4-dd67-43f7-8622-abf604bb94d2 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.720258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd56d4-dd67-43f7-8622-abf604bb94d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.720516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd56d4-dd67-43f7-8622-abf604bb94d2 None admin] PATH_INFO: `/v3/projects/7aeda51ceb91490690bfdb33edeb29ca` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.721663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd56d4-dd67-43f7-8622-abf604bb94d2 None admin] RBAC: Authorizing `identity:get_project(project_id=7aeda51ceb91490690bfdb33edeb29ca)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:03.723075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd56d4-dd67-43f7-8622-abf604bb94d2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:03.724741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 564/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:03 2022] GET /identity/v3/projects/7aeda51ceb91490690bfdb33edeb29ca => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:03.731026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e505-c55c-47b9-b113-643183c313dd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.827330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e505-c55c-47b9-b113-643183c313dd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.858841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab2acb-950f-4b62-97e4-33a3a180e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.859472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2acb-950f-4b62-97e4-33a3a180e819 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.859746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2acb-950f-4b62-97e4-33a3a180e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.860043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2acb-950f-4b62-97e4-33a3a180e819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.860855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab2acb-950f-4b62-97e4-33a3a180e819 None admin] RBAC: Adding query filter params (role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=7aeda51ceb91490690bfdb33edeb29ca, user.id=d8f82883152f4989a3b106d06eccbfda) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:03.861160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab2acb-950f-4b62-97e4-33a3a180e819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:03.862555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab2acb-950f-4b62-97e4-33a3a180e819 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:03.867730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 553/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:24:03 2022] GET /identity/v3/role_assignments?user.id=d8f82883152f4989a3b106d06eccbfda&scope.project.id=7aeda51ceb91490690bfdb33edeb29ca&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:05.938299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db097b-ae27-44fe-9459-55860fd223ce None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:05.938817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db097b-ae27-44fe-9459-55860fd223ce None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:05.938817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db097b-ae27-44fe-9459-55860fd223ce None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:05.940217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 565/1118] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:05.945410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93770-1a93-42d6-8428-836ca038bb14 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:05.945840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93770-1a93-42d6-8428-836ca038bb14 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:05.945970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93770-1a93-42d6-8428-836ca038bb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:05.962113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e9e93770-1a93-42d6-8428-836ca038bb14 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:05.963288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e9e93770-1a93-42d6-8428-836ca038bb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:05.985375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:06.027242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 554/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:06.049672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db097b-ae27-44fe-9459-55860fd223ce None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:06.065256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:06.147008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db097b-ae27-44fe-9459-55860fd223ce None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:06.180870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc392-d3ed-438d-ba94-2de560adb83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:06.181688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc392-d3ed-438d-ba94-2de560adb83f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:06.181962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc392-d3ed-438d-ba94-2de560adb83f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:06.182229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc392-d3ed-438d-ba94-2de560adb83f None admin] PATH_INFO: `/v3/roles/414930bf02ef4277b0b66bc57f1f1628` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:06.183663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cc392-d3ed-438d-ba94-2de560adb83f None admin] RBAC: Authorizing `identity:get_role(role_id=414930bf02ef4277b0b66bc57f1f1628)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:06.185066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cc392-d3ed-438d-ba94-2de560adb83f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:06.186389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 566/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:06 2022] GET /identity/v3/roles/414930bf02ef4277b0b66bc57f1f1628 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:06.192077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93770-1a93-42d6-8428-836ca038bb14 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:06.285462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93770-1a93-42d6-8428-836ca038bb14 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:06.317498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401c1c-3506-4dbd-a58a-76bb8c4d54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:06.318341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401c1c-3506-4dbd-a58a-76bb8c4d54e5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:06.318628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401c1c-3506-4dbd-a58a-76bb8c4d54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:06.318886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401c1c-3506-4dbd-a58a-76bb8c4d54e5 None admin] PATH_INFO: `/v3/users/d8f82883152f4989a3b106d06eccbfda` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:06.320057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401c1c-3506-4dbd-a58a-76bb8c4d54e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d8f82883152f4989a3b106d06eccbfda)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:06.321454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401c1c-3506-4dbd-a58a-76bb8c4d54e5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:06.323015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 555/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:06 2022] GET /identity/v3/users/d8f82883152f4989a3b106d06eccbfda => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:06.328626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc392-d3ed-438d-ba94-2de560adb83f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:06.407023 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:06.424624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc392-d3ed-438d-ba94-2de560adb83f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:06.456937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758a2c-89fe-4e3c-9f18-e19523dcc106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:06.457768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758a2c-89fe-4e3c-9f18-e19523dcc106 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:06.458052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758a2c-89fe-4e3c-9f18-e19523dcc106 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:06.458327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758a2c-89fe-4e3c-9f18-e19523dcc106 None admin] PATH_INFO: `/v3/projects/7aeda51ceb91490690bfdb33edeb29ca` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:06.459475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758a2c-89fe-4e3c-9f18-e19523dcc106 None admin] RBAC: Authorizing `identity:get_project(project_id=7aeda51ceb91490690bfdb33edeb29ca)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:06.460921 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758a2c-89fe-4e3c-9f18-e19523dcc106 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:06.462561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 567/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:06 2022] GET /identity/v3/projects/7aeda51ceb91490690bfdb33edeb29ca => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:06.468999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401c1c-3506-4dbd-a58a-76bb8c4d54e5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:06.495037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:06.564322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401c1c-3506-4dbd-a58a-76bb8c4d54e5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:06.597353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9e8ee-384f-41da-881e-0afed1ebaa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:06.598215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e8ee-384f-41da-881e-0afed1ebaa8d None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:06.598490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e8ee-384f-41da-881e-0afed1ebaa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:06.598761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e8ee-384f-41da-881e-0afed1ebaa8d None admin] PATH_INFO: `/v3/projects/7aeda51ceb91490690bfdb33edeb29ca/users/d8f82883152f4989a3b106d06eccbfda/roles/414930bf02ef4277b0b66bc57f1f1628` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:06.600946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9e8ee-384f-41da-881e-0afed1ebaa8d None admin] RBAC: Authorizing `identity:create_grant(project_id=7aeda51ceb91490690bfdb33edeb29ca, user_id=d8f82883152f4989a3b106d06eccbfda, role_id=414930bf02ef4277b0b66bc57f1f1628)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:06.602350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9e8ee-384f-41da-881e-0afed1ebaa8d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:06.675820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 556/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:24:06 2022] PUT /identity/v3/projects/7aeda51ceb91490690bfdb33edeb29ca/users/d8f82883152f4989a3b106d06eccbfda/roles/414930bf02ef4277b0b66bc57f1f1628 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:24:08.774882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800580c-aab3-4fd3-a265-2894c3ef56c8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:08.775350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800580c-aab3-4fd3-a265-2894c3ef56c8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:08.775454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800580c-aab3-4fd3-a265-2894c3ef56c8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:08.776819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 568/1124] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:08.781915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b325a-292d-4b22-b740-eafb8367aceb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:08.782275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b325a-292d-4b22-b740-eafb8367aceb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:08.782465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b325a-292d-4b22-b740-eafb8367aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:08.799080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-016b325a-292d-4b22-b740-eafb8367aceb None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:08.800274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-016b325a-292d-4b22-b740-eafb8367aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:08.863504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 557/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:08.887274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800580c-aab3-4fd3-a265-2894c3ef56c8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:08.984910 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800580c-aab3-4fd3-a265-2894c3ef56c8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:09.017959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c9cb-4c44-4079-a549-32449179f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:09.018732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c9cb-4c44-4079-a549-32449179f99e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:09.019016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c9cb-4c44-4079-a549-32449179f99e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:09.019292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c9cb-4c44-4079-a549-32449179f99e None admin] PATH_INFO: `/v3/roles/414930bf02ef4277b0b66bc57f1f1628` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:09.020775 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945c9cb-4c44-4079-a549-32449179f99e None admin] RBAC: Authorizing `identity:get_role(role_id=414930bf02ef4277b0b66bc57f1f1628)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:09.022126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945c9cb-4c44-4079-a549-32449179f99e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:09.023498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 569/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:08 2022] GET /identity/v3/roles/414930bf02ef4277b0b66bc57f1f1628 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:09.029088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b325a-292d-4b22-b740-eafb8367aceb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:09.046305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:09.123819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b325a-292d-4b22-b740-eafb8367aceb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:09.156403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910db18-172f-4636-91f4-ce536ea2e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:09.157257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910db18-172f-4636-91f4-ce536ea2e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:09.157537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910db18-172f-4636-91f4-ce536ea2e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:09.157813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910db18-172f-4636-91f4-ce536ea2e4f8 None admin] PATH_INFO: `/v3/users/d8f82883152f4989a3b106d06eccbfda` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:09.158983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910db18-172f-4636-91f4-ce536ea2e4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=d8f82883152f4989a3b106d06eccbfda)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:09.160437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910db18-172f-4636-91f4-ce536ea2e4f8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:09.162021 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 558/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:09 2022] GET /identity/v3/users/d8f82883152f4989a3b106d06eccbfda => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:09.167510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c9cb-4c44-4079-a549-32449179f99e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:09.186167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:09.263186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c9cb-4c44-4079-a549-32449179f99e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:09.296167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517641-e811-4000-a27f-3a01838ebd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:09.296792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517641-e811-4000-a27f-3a01838ebd2d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:09.297072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517641-e811-4000-a27f-3a01838ebd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:09.297346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517641-e811-4000-a27f-3a01838ebd2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:09.360788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99517641-e811-4000-a27f-3a01838ebd2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:09.362208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99517641-e811-4000-a27f-3a01838ebd2d None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:09.378691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:09.456006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 570/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:24:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:24:09.461959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910db18-172f-4636-91f4-ce536ea2e4f8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:09.544170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:09.559054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910db18-172f-4636-91f4-ce536ea2e4f8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:09.592429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ef4ed-ea35-4c01-8552-535170bf7b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:09.593261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ef4ed-ea35-4c01-8552-535170bf7b7c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:09.593546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ef4ed-ea35-4c01-8552-535170bf7b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:09.593818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ef4ed-ea35-4c01-8552-535170bf7b7c None admin] PATH_INFO: `/v3/projects/7aeda51ceb91490690bfdb33edeb29ca` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:09.594975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ef4ed-ea35-4c01-8552-535170bf7b7c None admin] RBAC: Authorizing `identity:get_project(project_id=7aeda51ceb91490690bfdb33edeb29ca)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:09.596424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ef4ed-ea35-4c01-8552-535170bf7b7c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:09.598093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 559/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:09 2022] GET /identity/v3/projects/7aeda51ceb91490690bfdb33edeb29ca => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:09.604264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517641-e811-4000-a27f-3a01838ebd2d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:09.698186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517641-e811-4000-a27f-3a01838ebd2d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:09.714884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:09.730908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420f90c-de3f-4cb4-ad6c-1d1036b66754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:09.732531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f90c-de3f-4cb4-ad6c-1d1036b66754 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:09.732531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f90c-de3f-4cb4-ad6c-1d1036b66754 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:09.732531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420f90c-de3f-4cb4-ad6c-1d1036b66754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:09.735468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420f90c-de3f-4cb4-ad6c-1d1036b66754 None admin] RBAC: Adding query filter params (role.id=414930bf02ef4277b0b66bc57f1f1628, scope.project.id=7aeda51ceb91490690bfdb33edeb29ca, user.id=d8f82883152f4989a3b106d06eccbfda) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:09.735468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420f90c-de3f-4cb4-ad6c-1d1036b66754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:09.735468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420f90c-de3f-4cb4-ad6c-1d1036b66754 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:09.742065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 571/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:24:09 2022] GET /identity/v3/role_assignments?user.id=d8f82883152f4989a3b106d06eccbfda&scope.project.id=7aeda51ceb91490690bfdb33edeb29ca&role.id=414930bf02ef4277b0b66bc57f1f1628 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:11.884847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f48699-ecfe-4730-aee9-9620c9c223e8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:11.885398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f48699-ecfe-4730-aee9-9620c9c223e8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:11.885398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f48699-ecfe-4730-aee9-9620c9c223e8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:11.886787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 560/1131] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:11.891996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221363-b4d5-4996-b792-14d4ded0fa4c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:11.892423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221363-b4d5-4996-b792-14d4ded0fa4c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:11.892552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221363-b4d5-4996-b792-14d4ded0fa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:11.909075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a1221363-b4d5-4996-b792-14d4ded0fa4c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:11.910244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a1221363-b4d5-4996-b792-14d4ded0fa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:11.973998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 572/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:11.998100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f48699-ecfe-4730-aee9-9620c9c223e8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:12.095984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f48699-ecfe-4730-aee9-9620c9c223e8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:12.128692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02869807-0a7b-41e5-a657-40927dba09eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:12.129553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02869807-0a7b-41e5-a657-40927dba09eb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:12.129843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02869807-0a7b-41e5-a657-40927dba09eb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:12.130121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02869807-0a7b-41e5-a657-40927dba09eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:12.131282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02869807-0a7b-41e5-a657-40927dba09eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:12.132727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02869807-0a7b-41e5-a657-40927dba09eb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:12.134574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 561/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:12.140169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1221363-b4d5-4996-b792-14d4ded0fa4c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:12.234038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1221363-b4d5-4996-b792-14d4ded0fa4c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:12.246389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:12.273258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74105e8-1e02-4221-877f-017b289a5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:12.273258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74105e8-1e02-4221-877f-017b289a5636 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:12.273258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74105e8-1e02-4221-877f-017b289a5636 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:12.273258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74105e8-1e02-4221-877f-017b289a5636 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:12.273647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74105e8-1e02-4221-877f-017b289a5636 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:12.273647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74105e8-1e02-4221-877f-017b289a5636 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:12.396695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 573/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:24:12 2022] POST /identity/v3/projects => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:24:14.525121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1c81-4895-4e94-a7b4-c43cdb632e32 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:14.525688 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1c81-4895-4e94-a7b4-c43cdb632e32 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:14.525688 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f1c81-4895-4e94-a7b4-c43cdb632e32 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:14.527027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 562/1135] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:14.532264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55004-9655-421d-baf0-9fd10f644b86 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:14.532638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55004-9655-421d-baf0-9fd10f644b86 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:14.532824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55004-9655-421d-baf0-9fd10f644b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:14.549269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-58e55004-9655-421d-baf0-9fd10f644b86 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:14.550443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-58e55004-9655-421d-baf0-9fd10f644b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:14.614725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 574/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:14.640254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f1c81-4895-4e94-a7b4-c43cdb632e32 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:14.661322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:14.739173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f1c81-4895-4e94-a7b4-c43cdb632e32 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:14.772353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be730-ef77-45e8-99b3-7b92aa53c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:14.773121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be730-ef77-45e8-99b3-7b92aa53c129 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:14.773396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be730-ef77-45e8-99b3-7b92aa53c129 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:14.773666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be730-ef77-45e8-99b3-7b92aa53c129 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:14.774835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19be730-ef77-45e8-99b3-7b92aa53c129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:14.776319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19be730-ef77-45e8-99b3-7b92aa53c129 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:14.777857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 563/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:24:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:14.783678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e55004-9655-421d-baf0-9fd10f644b86 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:14.871102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:14.877996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e55004-9655-421d-baf0-9fd10f644b86 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:14.909925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee252b8-dde4-4a7c-a0ff-767786e7812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:14.910566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee252b8-dde4-4a7c-a0ff-767786e7812f None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:14.910846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee252b8-dde4-4a7c-a0ff-767786e7812f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:14.911118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee252b8-dde4-4a7c-a0ff-767786e7812f None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:14.911811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee252b8-dde4-4a7c-a0ff-767786e7812f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:14.913262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee252b8-dde4-4a7c-a0ff-767786e7812f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:14.994492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 575/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:24:14 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:24:17.120681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ef7c-1247-4cbf-97fc-070bba1b7788 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:17.121239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ef7c-1247-4cbf-97fc-070bba1b7788 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:17.121239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961ef7c-1247-4cbf-97fc-070bba1b7788 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:17.123129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 564/1139] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:17.128203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763df21-aed0-41ee-b453-c56afa386bdc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:17.128595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763df21-aed0-41ee-b453-c56afa386bdc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:17.128748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763df21-aed0-41ee-b453-c56afa386bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:17.145171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e763df21-aed0-41ee-b453-c56afa386bdc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:17.146331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e763df21-aed0-41ee-b453-c56afa386bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:17.209181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 576/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:17.232060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961ef7c-1247-4cbf-97fc-070bba1b7788 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:17.317008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:17.329132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961ef7c-1247-4cbf-97fc-070bba1b7788 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:17.362182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7849ad4-9f8b-4777-b46b-3f612a4e2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:17.362949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7849ad4-9f8b-4777-b46b-3f612a4e2a91 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:17.363227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7849ad4-9f8b-4777-b46b-3f612a4e2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:17.363498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7849ad4-9f8b-4777-b46b-3f612a4e2a91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:17.373248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7849ad4-9f8b-4777-b46b-3f612a4e2a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f7849ad4-9f8b-4777-b46b-3f612a4e2a91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:24:17.380752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:17.381876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:24:17.382952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 565/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:17.388029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763df21-aed0-41ee-b453-c56afa386bdc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:17.464142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:17.482850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763df21-aed0-41ee-b453-c56afa386bdc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:17.515096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:17.515740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:17.516049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:17.516325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:17.517062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:17.517366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:17.518718 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:17.526814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 577/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:17.532836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7849ad4-9f8b-4777-b46b-3f612a4e2a91 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:17.628842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7849ad4-9f8b-4777-b46b-3f612a4e2a91 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:17.661485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c564bf-d310-4fcb-8acf-ae0ce8d30b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:17.662334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c564bf-d310-4fcb-8acf-ae0ce8d30b64 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:17.662618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c564bf-d310-4fcb-8acf-ae0ce8d30b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:17.662893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c564bf-d310-4fcb-8acf-ae0ce8d30b64 None admin] PATH_INFO: `/v3/users/44da9e506c5f42f1871a684bfe3e5756` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:17.676233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c564bf-d310-4fcb-8acf-ae0ce8d30b64 None admin] RBAC: Authorizing `identity:get_user(user_id=44da9e506c5f42f1871a684bfe3e5756)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:17.677665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c564bf-d310-4fcb-8acf-ae0ce8d30b64 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:17.679275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 566/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:17 2022] GET /identity/v3/users/44da9e506c5f42f1871a684bfe3e5756 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:17.684847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:17.783172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09c038-6620-4e1d-acc8-af1ffdde7928 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:17.815045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e6f71-f42b-46c1-8266-19ea5cf00f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:17.815690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e6f71-f42b-46c1-8266-19ea5cf00f6e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:17.816001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e6f71-f42b-46c1-8266-19ea5cf00f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:17.816280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e6f71-f42b-46c1-8266-19ea5cf00f6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:17.828248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:17.880999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e6f71-f42b-46c1-8266-19ea5cf00f6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:17.882423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e6f71-f42b-46c1-8266-19ea5cf00f6e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:17.976871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 578/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:24:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:24:17.982972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c564bf-d310-4fcb-8acf-ae0ce8d30b64 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:17.991562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:18.079395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c564bf-d310-4fcb-8acf-ae0ce8d30b64 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:18.111999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5b8a5-2920-4a7b-91e4-c9c7e9e92340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:18.112831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5b8a5-2920-4a7b-91e4-c9c7e9e92340 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:18.113113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5b8a5-2920-4a7b-91e4-c9c7e9e92340 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:18.113387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5b8a5-2920-4a7b-91e4-c9c7e9e92340 None admin] PATH_INFO: `/v3/projects/badd1f19aa4f4027b152833d41c80b34` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:18.114552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5b8a5-2920-4a7b-91e4-c9c7e9e92340 None admin] RBAC: Authorizing `identity:get_project(project_id=badd1f19aa4f4027b152833d41c80b34)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:18.115993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5b8a5-2920-4a7b-91e4-c9c7e9e92340 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:18.117646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 567/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:17 2022] GET /identity/v3/projects/badd1f19aa4f4027b152833d41c80b34 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:18.124854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e6f71-f42b-46c1-8266-19ea5cf00f6e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:18.168447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:18.222476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e6f71-f42b-46c1-8266-19ea5cf00f6e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:18.255082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea35959-804a-467f-8c67-292ee032664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:18.255723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35959-804a-467f-8c67-292ee032664a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:18.256030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35959-804a-467f-8c67-292ee032664a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:18.256304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35959-804a-467f-8c67-292ee032664a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:18.257125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea35959-804a-467f-8c67-292ee032664a None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=badd1f19aa4f4027b152833d41c80b34, user.id=44da9e506c5f42f1871a684bfe3e5756) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:18.257433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea35959-804a-467f-8c67-292ee032664a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:18.259125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea35959-804a-467f-8c67-292ee032664a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:18.264961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 579/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:24:18 2022] GET /identity/v3/role_assignments?user.id=44da9e506c5f42f1871a684bfe3e5756&scope.project.id=badd1f19aa4f4027b152833d41c80b34&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:20.316291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a425-0b97-4156-b183-ff3f25b864b4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:20.316815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a425-0b97-4156-b183-ff3f25b864b4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:20.316815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222a425-0b97-4156-b183-ff3f25b864b4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:20.318183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 568/1147] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:20.323214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88991519-4422-4ca3-bab8-2551d92d1716 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:20.323639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88991519-4422-4ca3-bab8-2551d92d1716 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:20.323772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88991519-4422-4ca3-bab8-2551d92d1716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:20.340593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-88991519-4422-4ca3-bab8-2551d92d1716 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:20.341772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-88991519-4422-4ca3-bab8-2551d92d1716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:20.405714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 580/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:20.427595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222a425-0b97-4156-b183-ff3f25b864b4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:20.500929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:20.525826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222a425-0b97-4156-b183-ff3f25b864b4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:20.557764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714694-130e-4254-abea-3dcfe0a2f01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:20.558533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714694-130e-4254-abea-3dcfe0a2f01e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:20.559312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714694-130e-4254-abea-3dcfe0a2f01e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:20.559581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714694-130e-4254-abea-3dcfe0a2f01e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:20.569254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714694-130e-4254-abea-3dcfe0a2f01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a9714694-130e-4254-abea-3dcfe0a2f01e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:24:20.577263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:20.578321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:24:20.584255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 569/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:20.585104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88991519-4422-4ca3-bab8-2551d92d1716 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:20.617166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:20.679211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88991519-4422-4ca3-bab8-2551d92d1716 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:20.712243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:20.712893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:20.713175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:20.713449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:20.714198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:20.714495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:20.715894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:20.723640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 581/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:20.729228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714694-130e-4254-abea-3dcfe0a2f01e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:20.825126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714694-130e-4254-abea-3dcfe0a2f01e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:20.857819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2720-5e53-426f-939c-4d51519fb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:20.858670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2720-5e53-426f-939c-4d51519fb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:20.858945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2720-5e53-426f-939c-4d51519fb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:20.859212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2720-5e53-426f-939c-4d51519fb2c0 None admin] PATH_INFO: `/v3/users/44da9e506c5f42f1871a684bfe3e5756` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:20.860392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf2720-5e53-426f-939c-4d51519fb2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=44da9e506c5f42f1871a684bfe3e5756)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:20.861792 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf2720-5e53-426f-939c-4d51519fb2c0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:20.863376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 570/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:20 2022] GET /identity/v3/users/44da9e506c5f42f1871a684bfe3e5756 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:20.869084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:20.960617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:20.964285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ebe4-3de4-4296-b047-b426874b9fde None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:20.996160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3bcc6-cbd1-42dd-b02b-5f7a43548e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:20.997526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3bcc6-cbd1-42dd-b02b-5f7a43548e62 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:20.997804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3bcc6-cbd1-42dd-b02b-5f7a43548e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:20.998072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3bcc6-cbd1-42dd-b02b-5f7a43548e62 None admin] PATH_INFO: `/v3/projects/badd1f19aa4f4027b152833d41c80b34` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:20.999220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3bcc6-cbd1-42dd-b02b-5f7a43548e62 None admin] RBAC: Authorizing `identity:get_project(project_id=badd1f19aa4f4027b152833d41c80b34)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:21.000659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3bcc6-cbd1-42dd-b02b-5f7a43548e62 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:21.002293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 582/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:20 2022] GET /identity/v3/projects/badd1f19aa4f4027b152833d41c80b34 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:21.008018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2720-5e53-426f-939c-4d51519fb2c0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:21.011060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:21.103640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2720-5e53-426f-939c-4d51519fb2c0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:21.135530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beb3a6-9e5b-445d-901d-bf6d37468d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:21.136421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beb3a6-9e5b-445d-901d-bf6d37468d78 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:21.136695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beb3a6-9e5b-445d-901d-bf6d37468d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:21.137006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beb3a6-9e5b-445d-901d-bf6d37468d78 None admin] PATH_INFO: `/v3/projects/badd1f19aa4f4027b152833d41c80b34/users/44da9e506c5f42f1871a684bfe3e5756/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:21.138897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61beb3a6-9e5b-445d-901d-bf6d37468d78 None admin] RBAC: Authorizing `identity:create_grant(project_id=badd1f19aa4f4027b152833d41c80b34, user_id=44da9e506c5f42f1871a684bfe3e5756, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:21.140333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61beb3a6-9e5b-445d-901d-bf6d37468d78 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:21.222608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 571/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:24:21 2022] PUT /identity/v3/projects/badd1f19aa4f4027b152833d41c80b34/users/44da9e506c5f42f1871a684bfe3e5756/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:24:23.312726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5810af-abcf-415a-af60-0cee5ef8d59b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:23.313287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5810af-abcf-415a-af60-0cee5ef8d59b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:23.313287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5810af-abcf-415a-af60-0cee5ef8d59b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:23.314629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 583/1154] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:23.319701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce06b-3e2d-4c51-91c4-12f71e09b660 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:23.320175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce06b-3e2d-4c51-91c4-12f71e09b660 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:23.320374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce06b-3e2d-4c51-91c4-12f71e09b660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:23.337449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-abfce06b-3e2d-4c51-91c4-12f71e09b660 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:23.338629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-abfce06b-3e2d-4c51-91c4-12f71e09b660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:23.397556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:23.407402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 572/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:23.430255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5810af-abcf-415a-af60-0cee5ef8d59b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:23.527581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5810af-abcf-415a-af60-0cee5ef8d59b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:23.559105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be743-9e20-4cb6-851e-28b70990346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:23.559869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be743-9e20-4cb6-851e-28b70990346d None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:23.560174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be743-9e20-4cb6-851e-28b70990346d None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:23.560446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be743-9e20-4cb6-851e-28b70990346d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:23.570523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888be743-9e20-4cb6-851e-28b70990346d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-888be743-9e20-4cb6-851e-28b70990346d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:24:23.578536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:23.579634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:24:23.580695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 584/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:23.585674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfce06b-3e2d-4c51-91c4-12f71e09b660 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:23.679702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfce06b-3e2d-4c51-91c4-12f71e09b660 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:23.712794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:23.713437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:23.713718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:23.713997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:23.714727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:23.715062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:23.716435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:23.724215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 573/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:23.730079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be743-9e20-4cb6-851e-28b70990346d None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:23.757848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:23.827029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be743-9e20-4cb6-851e-28b70990346d None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:23.860140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c96a6-31a0-4ee0-87b0-94823bd4e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:23.860976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c96a6-31a0-4ee0-87b0-94823bd4e572 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:23.861255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c96a6-31a0-4ee0-87b0-94823bd4e572 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:23.861527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c96a6-31a0-4ee0-87b0-94823bd4e572 None admin] PATH_INFO: `/v3/users/44da9e506c5f42f1871a684bfe3e5756` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:23.862684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c96a6-31a0-4ee0-87b0-94823bd4e572 None admin] RBAC: Authorizing `identity:get_user(user_id=44da9e506c5f42f1871a684bfe3e5756)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:23.864116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c96a6-31a0-4ee0-87b0-94823bd4e572 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:23.865705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 585/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:23 2022] GET /identity/v3/users/44da9e506c5f42f1871a684bfe3e5756 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:23.872059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:23.924687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:23.967642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2c52-8416-4c38-ab22-b4c7b0e8bc6b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:23.999712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db4d04-0c86-41f8-877d-945d161ecaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:24.000535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4d04-0c86-41f8-877d-945d161ecaec None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:24.000812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4d04-0c86-41f8-877d-945d161ecaec None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:24.001079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4d04-0c86-41f8-877d-945d161ecaec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:24.064838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db4d04-0c86-41f8-877d-945d161ecaec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:24.066261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db4d04-0c86-41f8-877d-945d161ecaec None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:24.116694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:24.160363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 574/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:24:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:24:24.166187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c96a6-31a0-4ee0-87b0-94823bd4e572 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:24.255325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:24.262659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c96a6-31a0-4ee0-87b0-94823bd4e572 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:24.294919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7623be1-850b-4070-9288-0b44f75d5483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:24.295752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623be1-850b-4070-9288-0b44f75d5483 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:24.296195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623be1-850b-4070-9288-0b44f75d5483 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:24.297843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7623be1-850b-4070-9288-0b44f75d5483 None admin] PATH_INFO: `/v3/projects/badd1f19aa4f4027b152833d41c80b34` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:24.298513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7623be1-850b-4070-9288-0b44f75d5483 None admin] RBAC: Authorizing `identity:get_project(project_id=badd1f19aa4f4027b152833d41c80b34)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:24.299952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7623be1-850b-4070-9288-0b44f75d5483 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:24.301602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 586/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:24 2022] GET /identity/v3/projects/badd1f19aa4f4027b152833d41c80b34 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:24.307525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db4d04-0c86-41f8-877d-945d161ecaec None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:24.402653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db4d04-0c86-41f8-877d-945d161ecaec None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:24.435001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb0a57-6bd9-4987-9e4c-d041b32e2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:24.435638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0a57-6bd9-4987-9e4c-d041b32e2af0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:24.435940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0a57-6bd9-4987-9e4c-d041b32e2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:24.436221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb0a57-6bd9-4987-9e4c-d041b32e2af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:24.437037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb0a57-6bd9-4987-9e4c-d041b32e2af0 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=badd1f19aa4f4027b152833d41c80b34, user.id=44da9e506c5f42f1871a684bfe3e5756) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:24.437348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb0a57-6bd9-4987-9e4c-d041b32e2af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:24.438766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb0a57-6bd9-4987-9e4c-d041b32e2af0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:24.444466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 575/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:24:24 2022] GET /identity/v3/role_assignments?user.id=44da9e506c5f42f1871a684bfe3e5756&scope.project.id=badd1f19aa4f4027b152833d41c80b34&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:26.561553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe5ec-0174-45ce-8876-af3f0f6061ae None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:26.562080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe5ec-0174-45ce-8876-af3f0f6061ae None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:26.562080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe5ec-0174-45ce-8876-af3f0f6061ae None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:26.563447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 587/1162] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:26.568463 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d31ffe-831b-4c0c-87c5-6bdf3ea35e81 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:26.568898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d31ffe-831b-4c0c-87c5-6bdf3ea35e81 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:26.569023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d31ffe-831b-4c0c-87c5-6bdf3ea35e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:26.585277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b9d31ffe-831b-4c0c-87c5-6bdf3ea35e81 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:26.586485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9d31ffe-831b-4c0c-87c5-6bdf3ea35e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:26.599656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:26.650665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 576/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:26.673657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fe5ec-0174-45ce-8876-af3f0f6061ae None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:26.770966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fe5ec-0174-45ce-8876-af3f0f6061ae None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:26.803193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f98e1-19d8-42db-8f13-1877213d58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:26.803822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f98e1-19d8-42db-8f13-1877213d58f6 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:26.804129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f98e1-19d8-42db-8f13-1877213d58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:26.804403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f98e1-19d8-42db-8f13-1877213d58f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:26.832790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:26.869521 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f98e1-19d8-42db-8f13-1877213d58f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:26.870957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f98e1-19d8-42db-8f13-1877213d58f6 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:26.965691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 588/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:24:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:24:26.971608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d31ffe-831b-4c0c-87c5-6bdf3ea35e81 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:27.067026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d31ffe-831b-4c0c-87c5-6bdf3ea35e81 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:27.099544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec63dc-cc3e-4912-85e2-86ae9d3a65fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:27.100297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec63dc-cc3e-4912-85e2-86ae9d3a65fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:27.100580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec63dc-cc3e-4912-85e2-86ae9d3a65fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:27.100855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec63dc-cc3e-4912-85e2-86ae9d3a65fe None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:27.107372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec63dc-cc3e-4912-85e2-86ae9d3a65fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:27.108838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec63dc-cc3e-4912-85e2-86ae9d3a65fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-63ec63dc-cc3e-4912-85e2-86ae9d3a65fe None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:27.123161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:27.124269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:24:27.125209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 577/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:24:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:27.130057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f98e1-19d8-42db-8f13-1877213d58f6 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:27.188857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:27.226038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f98e1-19d8-42db-8f13-1877213d58f6 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:27.257930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d623769-5988-4166-b49f-c734b5b4f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:27.258818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623769-5988-4166-b49f-c734b5b4f5af None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:27.259095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623769-5988-4166-b49f-c734b5b4f5af None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:27.259364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d623769-5988-4166-b49f-c734b5b4f5af None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:27.260109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d623769-5988-4166-b49f-c734b5b4f5af None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:27.260409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d623769-5988-4166-b49f-c734b5b4f5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:27.262353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d623769-5988-4166-b49f-c734b5b4f5af None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:27.269154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 589/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jun 15 00:24:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:29.332258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18266b-3bc4-4aac-be43-18ef58e2d4e8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:29.332816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18266b-3bc4-4aac-be43-18ef58e2d4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:29.332816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18266b-3bc4-4aac-be43-18ef58e2d4e8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:29.334187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 578/1167] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:29.339243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879daee3-0b3c-4014-974e-042f97f69ef8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:29.340111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879daee3-0b3c-4014-974e-042f97f69ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:29.340354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879daee3-0b3c-4014-974e-042f97f69ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:29.357031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-879daee3-0b3c-4014-974e-042f97f69ef8 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:29.358185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-879daee3-0b3c-4014-974e-042f97f69ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:29.421478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 590/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:29.443990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18266b-3bc4-4aac-be43-18ef58e2d4e8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:29.455999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:29.543685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18266b-3bc4-4aac-be43-18ef58e2d4e8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:29.575622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bf6d8-486b-42c3-a295-79fbca093e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:29.576305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bf6d8-486b-42c3-a295-79fbca093e17 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:29.576586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bf6d8-486b-42c3-a295-79fbca093e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:29.576858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bf6d8-486b-42c3-a295-79fbca093e17 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:29.577588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bf6d8-486b-42c3-a295-79fbca093e17 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:29.578934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bf6d8-486b-42c3-a295-79fbca093e17 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:29.664372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 579/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Jun 15 00:24:29 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:24:31.784131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68ebe-075b-41ba-87ab-397c39928906 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:31.784678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68ebe-075b-41ba-87ab-397c39928906 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:31.784678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68ebe-075b-41ba-87ab-397c39928906 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:31.786007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 591/1170] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:31.790980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd6c0-5f77-4a56-ae55-1ac2b56e2dca None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:31.791426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd6c0-5f77-4a56-ae55-1ac2b56e2dca None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:31.791532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd6c0-5f77-4a56-ae55-1ac2b56e2dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:31.808946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b00fd6c0-5f77-4a56-ae55-1ac2b56e2dca None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:31.810117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b00fd6c0-5f77-4a56-ae55-1ac2b56e2dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:31.868655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:31.874337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 580/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:31.898462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e68ebe-075b-41ba-87ab-397c39928906 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:31.954375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:31.996662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e68ebe-075b-41ba-87ab-397c39928906 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:32.028682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd21a0-8f11-4d2e-9429-23929f8b46d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:32.029516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd21a0-8f11-4d2e-9429-23929f8b46d8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:32.029798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd21a0-8f11-4d2e-9429-23929f8b46d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:32.030071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd21a0-8f11-4d2e-9429-23929f8b46d8 None admin] PATH_INFO: `/v3/domains/3161e99dc9734ce5b00d73885edfda82` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:32.040044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd21a0-8f11-4d2e-9429-23929f8b46d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3161e99dc9734ce5b00d73885edfda82)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:32.041477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd21a0-8f11-4d2e-9429-23929f8b46d8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:32.043604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 592/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Jun 15 00:24:31 2022] GET /identity/v3/domains/3161e99dc9734ce5b00d73885edfda82 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:32.049346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fd6c0-5f77-4a56-ae55-1ac2b56e2dca None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:32.142883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fd6c0-5f77-4a56-ae55-1ac2b56e2dca None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:32.175548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21169-93b0-4a19-b6f5-422c140595a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:32.176224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21169-93b0-4a19-b6f5-422c140595a6 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:32.176510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21169-93b0-4a19-b6f5-422c140595a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:32.176790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21169-93b0-4a19-b6f5-422c140595a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:32.177491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e21169-93b0-4a19-b6f5-422c140595a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:32.178906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e21169-93b0-4a19-b6f5-422c140595a6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:32.270427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 581/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:24:32 2022] POST /identity/v3/projects => generated 361 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:24:34.384800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c138-46b6-4181-9f25-150a05981e52 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:34.385346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c138-46b6-4181-9f25-150a05981e52 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:34.385346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c138-46b6-4181-9f25-150a05981e52 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:34.387201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 593/1174] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:34.392379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aff575-e3eb-487b-b223-34b8e5fb0af4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:34.392817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aff575-e3eb-487b-b223-34b8e5fb0af4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:34.392917 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aff575-e3eb-487b-b223-34b8e5fb0af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:34.409674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-33aff575-e3eb-487b-b223-34b8e5fb0af4 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:34.410831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-33aff575-e3eb-487b-b223-34b8e5fb0af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:34.454147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:34.474458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 582/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:34.498606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816c138-46b6-4181-9f25-150a05981e52 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:34.596253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816c138-46b6-4181-9f25-150a05981e52 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:34.611316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:34.628602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97638c-7e4a-4a83-be2d-fd82877cfa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:34.629403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97638c-7e4a-4a83-be2d-fd82877cfa60 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:34.629679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97638c-7e4a-4a83-be2d-fd82877cfa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:34.629950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97638c-7e4a-4a83-be2d-fd82877cfa60 None admin] PATH_INFO: `/v3/domains/3161e99dc9734ce5b00d73885edfda82` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:34.631211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97638c-7e4a-4a83-be2d-fd82877cfa60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3161e99dc9734ce5b00d73885edfda82)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:34.632651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97638c-7e4a-4a83-be2d-fd82877cfa60 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:34.634864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 594/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Jun 15 00:24:34 2022] GET /identity/v3/domains/3161e99dc9734ce5b00d73885edfda82 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:34.640708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aff575-e3eb-487b-b223-34b8e5fb0af4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:34.735061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aff575-e3eb-487b-b223-34b8e5fb0af4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:34.769295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c049b7-4b63-499d-97fd-171867163ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:34.769950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c049b7-4b63-499d-97fd-171867163ecb None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:34.770228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c049b7-4b63-499d-97fd-171867163ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:34.770497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c049b7-4b63-499d-97fd-171867163ecb None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:34.771191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c049b7-4b63-499d-97fd-171867163ecb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:34.772627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c049b7-4b63-499d-97fd-171867163ecb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:34.840720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 583/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:24:34 2022] POST /identity/v3/users => generated 311 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:24:37.006070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8d11-0bae-4bb5-8c20-fee61d3264a3 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:37.006569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8d11-0bae-4bb5-8c20-fee61d3264a3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:37.006569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8d11-0bae-4bb5-8c20-fee61d3264a3 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:37.007875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 595/1178] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:37.013931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79abc20-d8df-49e4-9cc8-7fd0e1f05507 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:37.014341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79abc20-d8df-49e4-9cc8-7fd0e1f05507 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:37.014484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79abc20-d8df-49e4-9cc8-7fd0e1f05507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:37.030667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c79abc20-d8df-49e4-9cc8-7fd0e1f05507 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:37.031837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c79abc20-d8df-49e4-9cc8-7fd0e1f05507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:37.059742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:37.096638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 584/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:37.120011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a8d11-0bae-4bb5-8c20-fee61d3264a3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:37.217211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a8d11-0bae-4bb5-8c20-fee61d3264a3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:37.249459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683dda2-0685-4300-9c89-033cb7bad8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:37.250223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683dda2-0685-4300-9c89-033cb7bad8ee None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:37.250503 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683dda2-0685-4300-9c89-033cb7bad8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:37.250781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683dda2-0685-4300-9c89-033cb7bad8ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:37.261256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683dda2-0685-4300-9c89-033cb7bad8ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7683dda2-0685-4300-9c89-033cb7bad8ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:24:37.268634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:37.269764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:24:37.270669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 596/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:37.275544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79abc20-d8df-49e4-9cc8-7fd0e1f05507 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:37.370390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79abc20-d8df-49e4-9cc8-7fd0e1f05507 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:37.403573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:37.404250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:37.404534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:37.404809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:37.405576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:37.405886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:37.407240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:37.415071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 585/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:37.421390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683dda2-0685-4300-9c89-033cb7bad8ee None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:37.466019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:37.519098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683dda2-0685-4300-9c89-033cb7bad8ee None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:37.551325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f60fb-ffae-478e-8c3a-f4e8baa872ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:37.552185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f60fb-ffae-478e-8c3a-f4e8baa872ee None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:37.552459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f60fb-ffae-478e-8c3a-f4e8baa872ee None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:37.552725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f60fb-ffae-478e-8c3a-f4e8baa872ee None admin] PATH_INFO: `/v3/users/50b840fb9f9e4487965b9a944e2277f8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:37.565748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f60fb-ffae-478e-8c3a-f4e8baa872ee None admin] RBAC: Authorizing `identity:get_user(user_id=50b840fb9f9e4487965b9a944e2277f8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:37.567181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f60fb-ffae-478e-8c3a-f4e8baa872ee None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:37.568803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 597/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:37 2022] GET /identity/v3/users/50b840fb9f9e4487965b9a944e2277f8 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:37.574523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:37.602934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:37.672114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7e27-3fd5-4cb1-b9ea-f2572b64696b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:37.703284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34342de-5b18-4f27-ad90-0b8c3f7b1905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:37.703944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34342de-5b18-4f27-ad90-0b8c3f7b1905 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:37.704227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34342de-5b18-4f27-ad90-0b8c3f7b1905 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:37.704500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34342de-5b18-4f27-ad90-0b8c3f7b1905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:37.768965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34342de-5b18-4f27-ad90-0b8c3f7b1905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:37.770450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34342de-5b18-4f27-ad90-0b8c3f7b1905 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:37.796415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:37.864076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 586/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:24:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:24:37.869940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f60fb-ffae-478e-8c3a-f4e8baa872ee None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:37.964075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f60fb-ffae-478e-8c3a-f4e8baa872ee None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:37.966135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:37.996988 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130b629-919a-448b-b16f-511bb9dca989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:37.997808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130b629-919a-448b-b16f-511bb9dca989 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:37.998085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130b629-919a-448b-b16f-511bb9dca989 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:37.998354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130b629-919a-448b-b16f-511bb9dca989 None admin] PATH_INFO: `/v3/projects/3c0e91e2c10f4017aca478f96430f72f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:37.999501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130b629-919a-448b-b16f-511bb9dca989 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0e91e2c10f4017aca478f96430f72f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:38.000934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130b629-919a-448b-b16f-511bb9dca989 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:38.002559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 598/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:37 2022] GET /identity/v3/projects/3c0e91e2c10f4017aca478f96430f72f => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:38.008749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34342de-5b18-4f27-ad90-0b8c3f7b1905 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:38.103315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34342de-5b18-4f27-ad90-0b8c3f7b1905 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:38.128607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:38.136765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25751876-1485-4c50-ad4b-748052beee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:38.137407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25751876-1485-4c50-ad4b-748052beee53 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:38.137687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25751876-1485-4c50-ad4b-748052beee53 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:38.137957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25751876-1485-4c50-ad4b-748052beee53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:38.138770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25751876-1485-4c50-ad4b-748052beee53 None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=3c0e91e2c10f4017aca478f96430f72f, user.id=50b840fb9f9e4487965b9a944e2277f8) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:38.139079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25751876-1485-4c50-ad4b-748052beee53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:38.140516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25751876-1485-4c50-ad4b-748052beee53 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:38.145674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 587/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:24:38 2022] GET /identity/v3/role_assignments?user.id=50b840fb9f9e4487965b9a944e2277f8&scope.project.id=3c0e91e2c10f4017aca478f96430f72f&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:40.212409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea22b7-de53-436e-be2f-fdd800682997 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:40.212954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea22b7-de53-436e-be2f-fdd800682997 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:40.212954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea22b7-de53-436e-be2f-fdd800682997 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:40.214895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 599/1186] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:40.219939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b5f66-7808-4d87-97a2-f83da35cfaf7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:40.220364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b5f66-7808-4d87-97a2-f83da35cfaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:40.220520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b5f66-7808-4d87-97a2-f83da35cfaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:40.236659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6a3b5f66-7808-4d87-97a2-f83da35cfaf7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:40.237817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6a3b5f66-7808-4d87-97a2-f83da35cfaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:40.301068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 588/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:40.323195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea22b7-de53-436e-be2f-fdd800682997 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:40.421636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea22b7-de53-436e-be2f-fdd800682997 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:40.454061 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5e649-264b-434e-a921-c4308615968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:40.454816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5e649-264b-434e-a921-c4308615968c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:40.455095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5e649-264b-434e-a921-c4308615968c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:40.455364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5e649-264b-434e-a921-c4308615968c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:40.465856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5e649-264b-434e-a921-c4308615968c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-02a5e649-264b-434e-a921-c4308615968c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:24:40.473264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:40.474170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:24:40.475019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 600/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:40.480445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b5f66-7808-4d87-97a2-f83da35cfaf7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:40.574096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b5f66-7808-4d87-97a2-f83da35cfaf7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:40.595127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:40.605971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:40.620017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:40.620017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:40.620017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:40.620017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:40.620017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:40.620017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:40.621013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 589/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:40.623211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5e649-264b-434e-a921-c4308615968c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:40.653836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:40.720886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5e649-264b-434e-a921-c4308615968c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:40.753676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063689-5956-4b0b-ab82-519777fb122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:40.754532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063689-5956-4b0b-ab82-519777fb122c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:40.754811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063689-5956-4b0b-ab82-519777fb122c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:40.755083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063689-5956-4b0b-ab82-519777fb122c None admin] PATH_INFO: `/v3/users/50b840fb9f9e4487965b9a944e2277f8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:40.756299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063689-5956-4b0b-ab82-519777fb122c None admin] RBAC: Authorizing `identity:get_user(user_id=50b840fb9f9e4487965b9a944e2277f8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:40.757727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063689-5956-4b0b-ab82-519777fb122c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:40.759597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 601/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:40 2022] GET /identity/v3/users/50b840fb9f9e4487965b9a944e2277f8 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:40.765893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:40.860645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f2be5-ad3b-4605-ab0e-9d73279124b9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:40.893240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790216ea-3f80-4205-9cde-8479d23042c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:40.894072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790216ea-3f80-4205-9cde-8479d23042c6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:40.894353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790216ea-3f80-4205-9cde-8479d23042c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:40.894628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790216ea-3f80-4205-9cde-8479d23042c6 None admin] PATH_INFO: `/v3/projects/3c0e91e2c10f4017aca478f96430f72f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:40.895775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790216ea-3f80-4205-9cde-8479d23042c6 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0e91e2c10f4017aca478f96430f72f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:40.897210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790216ea-3f80-4205-9cde-8479d23042c6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:40.898883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 590/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:40 2022] GET /identity/v3/projects/3c0e91e2c10f4017aca478f96430f72f => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:40.904490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063689-5956-4b0b-ab82-519777fb122c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:41.001559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:41.005213 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063689-5956-4b0b-ab82-519777fb122c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:41.037241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d734d8-3b5f-4777-b3fd-a5c176c76bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:41.038102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d734d8-3b5f-4777-b3fd-a5c176c76bd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:41.038387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d734d8-3b5f-4777-b3fd-a5c176c76bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:41.038661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d734d8-3b5f-4777-b3fd-a5c176c76bd1 None admin] PATH_INFO: `/v3/projects/3c0e91e2c10f4017aca478f96430f72f/users/50b840fb9f9e4487965b9a944e2277f8/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:41.040609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d734d8-3b5f-4777-b3fd-a5c176c76bd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0e91e2c10f4017aca478f96430f72f, user_id=50b840fb9f9e4487965b9a944e2277f8, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:41.042536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d734d8-3b5f-4777-b3fd-a5c176c76bd1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:41.109630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 602/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:24:40 2022] PUT /identity/v3/projects/3c0e91e2c10f4017aca478f96430f72f/users/50b840fb9f9e4487965b9a944e2277f8/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:24:43.183394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7d72-d9ca-4aa4-ac7b-789e1777eba0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:43.183954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7d72-d9ca-4aa4-ac7b-789e1777eba0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:43.183954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d7d72-d9ca-4aa4-ac7b-789e1777eba0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:43.185331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 591/1193] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:43.190502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab467bc-e6f3-4805-a877-2d02fa672151 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:43.190907 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab467bc-e6f3-4805-a877-2d02fa672151 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:43.191063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab467bc-e6f3-4805-a877-2d02fa672151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:43.207824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6ab467bc-e6f3-4805-a877-2d02fa672151 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:43.209069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6ab467bc-e6f3-4805-a877-2d02fa672151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:43.272764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 603/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:43.295945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7d72-d9ca-4aa4-ac7b-789e1777eba0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:43.348162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:43.393502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d7d72-d9ca-4aa4-ac7b-789e1777eba0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:43.425455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57e7e-52e4-40ea-a9d2-1a8fd2fe2a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:43.426226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57e7e-52e4-40ea-a9d2-1a8fd2fe2a5e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:43.426507 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57e7e-52e4-40ea-a9d2-1a8fd2fe2a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:43.426782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57e7e-52e4-40ea-a9d2-1a8fd2fe2a5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:43.436593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc57e7e-52e4-40ea-a9d2-1a8fd2fe2a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3fc57e7e-52e4-40ea-a9d2-1a8fd2fe2a5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:24:43.444043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:43.445091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:24:43.446031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 592/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:43.451492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab467bc-e6f3-4805-a877-2d02fa672151 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:43.534553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:43.545625 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab467bc-e6f3-4805-a877-2d02fa672151 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:43.578771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:43.579412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:43.579691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:43.579990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:43.580726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:43.581030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:43.582375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:43.590299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 604/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:43.595919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57e7e-52e4-40ea-a9d2-1a8fd2fe2a5e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:43.692022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57e7e-52e4-40ea-a9d2-1a8fd2fe2a5e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:43.704644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:43.724627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e505b-f1ad-48a0-aa00-5d32088bdbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:43.725473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e505b-f1ad-48a0-aa00-5d32088bdbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:43.725753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e505b-f1ad-48a0-aa00-5d32088bdbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:43.726023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e505b-f1ad-48a0-aa00-5d32088bdbf0 None admin] PATH_INFO: `/v3/users/50b840fb9f9e4487965b9a944e2277f8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:43.727186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e505b-f1ad-48a0-aa00-5d32088bdbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=50b840fb9f9e4487965b9a944e2277f8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:43.728641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e505b-f1ad-48a0-aa00-5d32088bdbf0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:43.730299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 593/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:43 2022] GET /identity/v3/users/50b840fb9f9e4487965b9a944e2277f8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:43.736086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:43.831385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0b3a-9be7-487c-a981-f68b225bd439 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:43.862316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9e1f4-3551-4f5c-8b8f-53a8582b0525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:43.862940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9e1f4-3551-4f5c-8b8f-53a8582b0525 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:43.863218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9e1f4-3551-4f5c-8b8f-53a8582b0525 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:43.863489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9e1f4-3551-4f5c-8b8f-53a8582b0525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:43.881741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:43.927677 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9e1f4-3551-4f5c-8b8f-53a8582b0525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:43.929120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9e1f4-3551-4f5c-8b8f-53a8582b0525 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:44.022038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 605/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:24:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:24:44.027755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e505b-f1ad-48a0-aa00-5d32088bdbf0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:44.123795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e505b-f1ad-48a0-aa00-5d32088bdbf0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:44.155459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ce9d9-63b6-4284-860c-3bf92495b7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:44.156319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ce9d9-63b6-4284-860c-3bf92495b7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:44.156600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ce9d9-63b6-4284-860c-3bf92495b7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:44.156871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ce9d9-63b6-4284-860c-3bf92495b7a0 None admin] PATH_INFO: `/v3/projects/3c0e91e2c10f4017aca478f96430f72f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:44.158027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ce9d9-63b6-4284-860c-3bf92495b7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0e91e2c10f4017aca478f96430f72f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:44.159430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ce9d9-63b6-4284-860c-3bf92495b7a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:44.161121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 594/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:44 2022] GET /identity/v3/projects/3c0e91e2c10f4017aca478f96430f72f => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:44.167545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9e1f4-3551-4f5c-8b8f-53a8582b0525 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:44.215434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:44.263668 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9e1f4-3551-4f5c-8b8f-53a8582b0525 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:44.295671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b03c9c-a083-437b-9e1d-0afbc7ea98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:44.296333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03c9c-a083-437b-9e1d-0afbc7ea98bf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:44.296612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03c9c-a083-437b-9e1d-0afbc7ea98bf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:44.296880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b03c9c-a083-437b-9e1d-0afbc7ea98bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:44.297692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03c9c-a083-437b-9e1d-0afbc7ea98bf None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=3c0e91e2c10f4017aca478f96430f72f, user.id=50b840fb9f9e4487965b9a944e2277f8) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:44.298003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03c9c-a083-437b-9e1d-0afbc7ea98bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:44.299409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b03c9c-a083-437b-9e1d-0afbc7ea98bf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:44.304984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 606/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:24:44 2022] GET /identity/v3/role_assignments?user.id=50b840fb9f9e4487965b9a944e2277f8&scope.project.id=3c0e91e2c10f4017aca478f96430f72f&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:54.151372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=76 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:54.302415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=43 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:56.243144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6002c2-0220-4372-9852-3ae87d4732be None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:56.243757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6002c2-0220-4372-9852-3ae87d4732be None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:56.243757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6002c2-0220-4372-9852-3ae87d4732be None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:56.245120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 595/1201] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:56.250250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eb441-7769-4307-9096-93fbee0e4115 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:56.250672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eb441-7769-4307-9096-93fbee0e4115 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:56.250811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47eb441-7769-4307-9096-93fbee0e4115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:56.270451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f47eb441-7769-4307-9096-93fbee0e4115 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:56.276601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f47eb441-7769-4307-9096-93fbee0e4115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:56.341100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 607/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:56.365119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6002c2-0220-4372-9852-3ae87d4732be None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:56.463832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6002c2-0220-4372-9852-3ae87d4732be None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:56.496312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:56.497029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:56.497311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:56.497578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:56.507655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:56.510027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:56.526339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:56.527476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:56.528682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:56.528682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:56.528682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:56.528682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:25:56.528682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 596/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:56.533634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47eb441-7769-4307-9096-93fbee0e4115 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:56.629971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47eb441-7769-4307-9096-93fbee0e4115 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:56.659082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:56.664401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab35d-5aed-43c0-9e75-3b9de1df5169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:56.665539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab35d-5aed-43c0-9e75-3b9de1df5169 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:56.665816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab35d-5aed-43c0-9e75-3b9de1df5169 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:56.666084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab35d-5aed-43c0-9e75-3b9de1df5169 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:56.666793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab35d-5aed-43c0-9e75-3b9de1df5169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:56.667093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab35d-5aed-43c0-9e75-3b9de1df5169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:56.668490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab35d-5aed-43c0-9e75-3b9de1df5169 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:56.679075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 608/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:56.685429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:56.738035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:56.783998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefcc5f-e641-4062-a2f0-74842995dce5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:56.817079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c0bd2-66ed-4bf2-8c8f-20048f0a8e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:56.817761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c0bd2-66ed-4bf2-8c8f-20048f0a8e9c None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:56.818042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c0bd2-66ed-4bf2-8c8f-20048f0a8e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:56.818314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c0bd2-66ed-4bf2-8c8f-20048f0a8e9c None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:56.818995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c0bd2-66ed-4bf2-8c8f-20048f0a8e9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:56.820438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c0bd2-66ed-4bf2-8c8f-20048f0a8e9c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:56.918882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 597/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jun 15 00:25:56 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:25:59.036993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29013ed-b405-4c4e-86c1-d20e725f96f0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:59.037523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29013ed-b405-4c4e-86c1-d20e725f96f0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:59.037523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29013ed-b405-4c4e-86c1-d20e725f96f0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:59.038894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 609/1206] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:59.044425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3730d-b849-4122-a4ef-93f05216241f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:59.044862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3730d-b849-4122-a4ef-93f05216241f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:59.044989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3730d-b849-4122-a4ef-93f05216241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:59.062796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-60a3730d-b849-4122-a4ef-93f05216241f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:59.064003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-60a3730d-b849-4122-a4ef-93f05216241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:59.130392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 598/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:59.153619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29013ed-b405-4c4e-86c1-d20e725f96f0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:59.254348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29013ed-b405-4c4e-86c1-d20e725f96f0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:59.287310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b213b2-be66-4ba9-a04a-0e6f35d9f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:59.288063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b213b2-be66-4ba9-a04a-0e6f35d9f301 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:59.288370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b213b2-be66-4ba9-a04a-0e6f35d9f301 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:59.288648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b213b2-be66-4ba9-a04a-0e6f35d9f301 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:59.299708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b213b2-be66-4ba9-a04a-0e6f35d9f301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c6b213b2-be66-4ba9-a04a-0e6f35d9f301 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:25:59.307355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:59.309082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:25:59.309956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 610/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:59.314790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3730d-b849-4122-a4ef-93f05216241f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:59.353217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:59.411253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3730d-b849-4122-a4ef-93f05216241f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:59.443083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:59.443733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:59.444040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:59.444310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:59.445043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:59.445342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:59.446685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:59.454117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 599/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:59.459897 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b213b2-be66-4ba9-a04a-0e6f35d9f301 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:59.510807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:59.559202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b213b2-be66-4ba9-a04a-0e6f35d9f301 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:59.592879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:59.593677 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:59.593955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:59.594227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:59.604696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:59.608453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:59.623265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:59.624315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:59.625490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:59.625490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:59.625490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:59.625490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:25:59.625490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 611/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:59.630236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:59.725988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:59.728980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d850ee-6fdc-427d-ae65-5f411fceeb6d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:59.762545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:59.770318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:59.770318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:59.770318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:59.770318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:59.770318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:59.770318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:59.778458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 600/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:59.784114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:59.882194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d93f30-376a-4602-9ac9-89bdea764c33 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:59.884431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:59.916640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:59.917632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:59.918123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:59.918456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:59.925952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:59.928081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:25:59.942110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:59.943091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:25:59.944098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 612/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:59.949581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:00.047699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2d02-0b6c-4688-81c7-588717549cbf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:00.080119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:00.080780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:00.081062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:00.081335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:00.082161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:00.082469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:00.083942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:00.100808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 601/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jun 15 00:25:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:00.107299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:00.205878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093bbdc-662e-44d1-89ae-3660e1a529b4 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:00.239579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040b6b5-6a81-4e6f-9016-dc5bd4c2a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:00.240259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040b6b5-6a81-4e6f-9016-dc5bd4c2a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:00.240542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040b6b5-6a81-4e6f-9016-dc5bd4c2a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:00.240820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040b6b5-6a81-4e6f-9016-dc5bd4c2a2c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:00.269940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:00.306562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040b6b5-6a81-4e6f-9016-dc5bd4c2a2c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:00.308038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040b6b5-6a81-4e6f-9016-dc5bd4c2a2c9 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:00.405655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 613/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:26:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:26:00.411408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:00.429969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:00.510682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c967b0-275a-4c2a-aa10-788aaef87987 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:00.543691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:00.544511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:00.549635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:00.549635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:00.554804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:00.556278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:00.574598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:00.575637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:00.576754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:00.576754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:00.576754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:00.576754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:00.576754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 602/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:00.581622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040b6b5-6a81-4e6f-9016-dc5bd4c2a2c9 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:00.641062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:00.679206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040b6b5-6a81-4e6f-9016-dc5bd4c2a2c9 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:00.714750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:00.715556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:00.715839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:00.716142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:00.716860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:00.717277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:00.718605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:00.729774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 614/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:00.735396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:00.806184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:00.835605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875c5e0-9634-424a-bae2-a68765327445 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:00.868321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:00.869100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:00.869383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:00.869663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:00.876318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:00.877756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:26:00.892042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:00.893114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:00.894184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 603/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:00.899056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:00.994770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efd3ee-07d7-43bc-b41c-e71eda4f289b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:01.016877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:01.028099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaac1e9-635e-4ef5-80dd-3b3d54d76258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:01.028754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac1e9-635e-4ef5-80dd-3b3d54d76258 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:01.029033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac1e9-635e-4ef5-80dd-3b3d54d76258 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:01.029303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac1e9-635e-4ef5-80dd-3b3d54d76258 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:01.030121 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaac1e9-635e-4ef5-80dd-3b3d54d76258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:01.030395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaac1e9-635e-4ef5-80dd-3b3d54d76258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:01.031896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaac1e9-635e-4ef5-80dd-3b3d54d76258 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:01.043871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 615/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:01.049859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:01.148506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337ad75-493f-447b-a770-2398800ace7d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:01.176710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:01.182942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea8f91-1d3c-4674-9329-cfc1b7e5c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:01.183583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8f91-1d3c-4674-9329-cfc1b7e5c106 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:01.183862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8f91-1d3c-4674-9329-cfc1b7e5c106 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:01.184166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8f91-1d3c-4674-9329-cfc1b7e5c106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:01.184985 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea8f91-1d3c-4674-9329-cfc1b7e5c106 None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=f6cc8de6532145799454b27e742259d9) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:01.185346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea8f91-1d3c-4674-9329-cfc1b7e5c106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:01.186752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea8f91-1d3c-4674-9329-cfc1b7e5c106 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:01.192096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 604/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:26:01 2022] GET /identity/v3/role_assignments?user.id=f6cc8de6532145799454b27e742259d9&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:03.296498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46f43-7d73-4349-b1b6-60e05f566918 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:03.297134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46f43-7d73-4349-b1b6-60e05f566918 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:03.297134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46f43-7d73-4349-b1b6-60e05f566918 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:03.298401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 616/1220] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:03.303700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f94a5-0317-4421-97d6-0727dabe8f46 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:03.304130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f94a5-0317-4421-97d6-0727dabe8f46 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:03.304280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f94a5-0317-4421-97d6-0727dabe8f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:03.321842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-839f94a5-0317-4421-97d6-0727dabe8f46 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:03.329496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-839f94a5-0317-4421-97d6-0727dabe8f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:03.387797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 605/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:03.410419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c46f43-7d73-4349-b1b6-60e05f566918 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:03.510104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c46f43-7d73-4349-b1b6-60e05f566918 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:03.543377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444fb21-2363-4813-bf49-df7d9e178296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:03.544187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444fb21-2363-4813-bf49-df7d9e178296 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:03.544469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444fb21-2363-4813-bf49-df7d9e178296 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:03.544738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444fb21-2363-4813-bf49-df7d9e178296 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:03.554662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444fb21-2363-4813-bf49-df7d9e178296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-e444fb21-2363-4813-bf49-df7d9e178296 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:26:03.562825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:03.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:03.565119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 617/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:26:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:03.570327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f94a5-0317-4421-97d6-0727dabe8f46 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:03.666145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f94a5-0317-4421-97d6-0727dabe8f46 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:03.689305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:03.699668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:03.700356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:03.700640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:03.700913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:03.701743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:03.702042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:03.703378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:03.711372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 606/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:26:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:03.717194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444fb21-2363-4813-bf49-df7d9e178296 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:03.762069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:03.817169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444fb21-2363-4813-bf49-df7d9e178296 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:03.849346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:03.850114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:03.850395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:03.850670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:03.861433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:03.862864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:03.879489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:03.880500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:03.881401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:03.881401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:03.881401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:03.881401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:03.881401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 618/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:03.886868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:03.986437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2931-a09f-4e9e-835b-780f378a4ad2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:04.018814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:04.019470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:04.019756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:04.020135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:04.020816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:04.021122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:04.022481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:04.034330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 607/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:04.040785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:04.130226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:04.136792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d67ec-da6f-4bba-8a7a-f23e4c482718 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:04.169116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:04.170078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:04.170524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:04.171120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:04.178380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:04.179828 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:26:04.193595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:04.194814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:04.201701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 619/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:04.202605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:04.248320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:04.301222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac753-5602-48af-9925-13d05ca11f2e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:04.334566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:04.335219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:04.335499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:04.335772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:04.337246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:04.337555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:04.338963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:04.355378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 608/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jun 15 00:26:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:04.361167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:04.460271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec35f3d-29da-4511-8288-a0d2ac0c8fd7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:04.492820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:04.493608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:04.494792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:04.494792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:04.504433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:04.505870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:04.522812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:04.524426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:04.525539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:04.525539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:04.525539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:04.525539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:04.528071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 620/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:04.530402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:04.625693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed946d9-c122-4b86-a517-37b02589c51c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:04.627922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:04.658906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:04.659560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:04.659842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:04.660145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:04.660900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:04.661258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:04.662612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:04.673681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 609/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:04.679548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:04.689333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:04.780604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f94b6-b9b7-4fb1-aa68-30328276d84f None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:04.813518 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:04.814357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:04.814643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:04.814923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:04.822004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:04.823437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:26:04.837436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:04.838431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:04.839524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 621/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:04.844573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:04.942362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454bafd-0c82-4ef8-892f-776c039d3ce5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:04.974535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41559649-992f-4c84-b59e-ec8bb41cb7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:04.975195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559649-992f-4c84-b59e-ec8bb41cb7ad None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:04.975475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559649-992f-4c84-b59e-ec8bb41cb7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:04.975744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559649-992f-4c84-b59e-ec8bb41cb7ad None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:04.976549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41559649-992f-4c84-b59e-ec8bb41cb7ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:04.977393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41559649-992f-4c84-b59e-ec8bb41cb7ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:04.978764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41559649-992f-4c84-b59e-ec8bb41cb7ad None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:04.990407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 610/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:04.997006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:05.060569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:05.093170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc81cbb-c302-44a9-a63c-05ec41699b49 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:05.126268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0f1b6-9112-49ee-b2fb-d0f908f420f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:05.127290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f1b6-9112-49ee-b2fb-d0f908f420f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:05.127567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f1b6-9112-49ee-b2fb-d0f908f420f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:05.127838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f1b6-9112-49ee-b2fb-d0f908f420f1 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/f6cc8de6532145799454b27e742259d9/roles/027b6713998845388cfa9f77e136eb9e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:05.141875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0f1b6-9112-49ee-b2fb-d0f908f420f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=f6cc8de6532145799454b27e742259d9, role_id=027b6713998845388cfa9f77e136eb9e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:05.143312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0f1b6-9112-49ee-b2fb-d0f908f420f1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:05.272850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 622/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:26:04 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/f6cc8de6532145799454b27e742259d9/roles/027b6713998845388cfa9f77e136eb9e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:26:07.347143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6e53-b0c2-42ff-9b7a-2c6fb19d4ab7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:07.347698 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6e53-b0c2-42ff-9b7a-2c6fb19d4ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:07.347698 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc6e53-b0c2-42ff-9b7a-2c6fb19d4ab7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:07.349058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 611/1233] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:07.354212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdebee-9408-49b9-bc4e-7b9fea6fc234 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:07.354625 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdebee-9408-49b9-bc4e-7b9fea6fc234 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:07.354754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdebee-9408-49b9-bc4e-7b9fea6fc234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:07.370739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-33cdebee-9408-49b9-bc4e-7b9fea6fc234 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:07.371954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-33cdebee-9408-49b9-bc4e-7b9fea6fc234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:07.436924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 623/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:07.460493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6e53-b0c2-42ff-9b7a-2c6fb19d4ab7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:07.486231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:07.558804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc6e53-b0c2-42ff-9b7a-2c6fb19d4ab7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:07.591955 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7202fe-ee32-4c80-ac22-3582168b1aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:07.592759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7202fe-ee32-4c80-ac22-3582168b1aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:07.593020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7202fe-ee32-4c80-ac22-3582168b1aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:07.593306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7202fe-ee32-4c80-ac22-3582168b1aa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:07.603496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7202fe-ee32-4c80-ac22-3582168b1aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0f7202fe-ee32-4c80-ac22-3582168b1aa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:26:07.611108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:07.612230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:07.613256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 612/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jun 15 00:26:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:07.619900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdebee-9408-49b9-bc4e-7b9fea6fc234 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:07.665772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:07.716811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdebee-9408-49b9-bc4e-7b9fea6fc234 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:07.751762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:07.752452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:07.752731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:07.752999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:07.753737 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] RBAC: Adding query filter params (name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:07.754037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:07.755381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:07.764795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 624/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jun 15 00:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:07.770485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7202fe-ee32-4c80-ac22-3582168b1aa9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:07.855716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:07.870961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7202fe-ee32-4c80-ac22-3582168b1aa9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:07.903040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:07.903846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:07.904153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:07.904430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:07.915682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:07.917149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:07.934846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:07.940760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:07.941632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:07.941632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:07.941632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:07.941632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:07.941632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 613/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:07.941923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:08.042866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d350e5-18c6-4bf1-925f-405bb106f200 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:08.051999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:08.077016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:08.077653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:08.077935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:08.078210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:08.078933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:08.079239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:08.080626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:08.091491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 625/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:08.097219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:08.195033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa890d-3ebf-4408-9ceb-cf3133f8f315 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:08.227558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:08.228369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:08.228648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:08.228919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:08.231600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:08.236501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:08.237979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:26:08.252347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:08.253337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:08.254464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 614/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:08.259454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:08.356886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5aec5-39f8-499c-a1fa-d1f1110aca35 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:08.388974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:08.389631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:08.389912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:08.390185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:08.391011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:08.391315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:08.392762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:08.410108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 626/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jun 15 00:26:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:08.416531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:08.514326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1333792-4d18-462e-a39a-56629fb49787 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:08.547362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd18773-5af4-45dc-bb94-f2fc35284eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:08.548023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18773-5af4-45dc-bb94-f2fc35284eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:08.548308 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18773-5af4-45dc-bb94-f2fc35284eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:08.548583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18773-5af4-45dc-bb94-f2fc35284eb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:08.610220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:08.616852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd18773-5af4-45dc-bb94-f2fc35284eb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:08.618311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd18773-5af4-45dc-bb94-f2fc35284eb1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:08.715928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 615/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:26:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:26:08.721876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:08.749109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:08.817165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae18420-7a25-44a1-b80c-281895b7763b None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:08.849810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:08.850578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:08.850853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:08.851122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:08.860963 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:08.863006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:08.879655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:08.880706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:08.881787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:08.881787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:08.881787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:08.881787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:08.881787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 627/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:08.887420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd18773-5af4-45dc-bb94-f2fc35284eb1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:08.979191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:08.985266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd18773-5af4-45dc-bb94-f2fc35284eb1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:09.018280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:09.018929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:09.019226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:09.019499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:09.020261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:09.020564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:09.021906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:09.033372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 616/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:09.040448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:09.114812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:09.136795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90b8f2-b542-400f-b55d-de7ce59bd649 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:09.168488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:09.169258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:09.169540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:09.169811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:09.176117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:09.177548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:26:09.191184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:09.192278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:09.193382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 628/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:09.198715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:09.295841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72b25-af9f-4159-8b98-dc534e535383 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:09.328746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6214-4a46-4bdc-827f-cc051ea7c85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:09.329397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6214-4a46-4bdc-827f-cc051ea7c85a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:09.329678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6214-4a46-4bdc-827f-cc051ea7c85a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:09.329951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6214-4a46-4bdc-827f-cc051ea7c85a None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:09.330728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6214-4a46-4bdc-827f-cc051ea7c85a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:09.331037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6214-4a46-4bdc-827f-cc051ea7c85a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:09.332483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6214-4a46-4bdc-827f-cc051ea7c85a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:09.344101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 617/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:09.350244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:09.450108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010524b-f0de-48f7-ae09-44ab7ea62ecc None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:09.483430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20007a-b147-4ef4-b71c-676cd2f495ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:09.484280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20007a-b147-4ef4-b71c-676cd2f495ba None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:09.484638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20007a-b147-4ef4-b71c-676cd2f495ba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:09.484928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20007a-b147-4ef4-b71c-676cd2f495ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:09.485959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20007a-b147-4ef4-b71c-676cd2f495ba None admin] RBAC: Adding query filter params (role.id=027b6713998845388cfa9f77e136eb9e, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=f6cc8de6532145799454b27e742259d9) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:09.486275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20007a-b147-4ef4-b71c-676cd2f495ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:09.487973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20007a-b147-4ef4-b71c-676cd2f495ba None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:09.494487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 629/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:26:09 2022] GET /identity/v3/role_assignments?user.id=f6cc8de6532145799454b27e742259d9&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=027b6713998845388cfa9f77e136eb9e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:11.663713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fbcce-9f17-45eb-b033-7cbcca2e3758 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:11.664823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fbcce-9f17-45eb-b033-7cbcca2e3758 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:11.664920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fbcce-9f17-45eb-b033-7cbcca2e3758 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:11.666293 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 618/1247] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:11.671328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e9f4-c154-4bf8-8b6f-f0e496fb589f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:11.671743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e9f4-c154-4bf8-8b6f-f0e496fb589f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:11.671980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e9f4-c154-4bf8-8b6f-f0e496fb589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:11.677108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:11.688805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7876e9f4-c154-4bf8-8b6f-f0e496fb589f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:11.689972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7876e9f4-c154-4bf8-8b6f-f0e496fb589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:11.756055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 630/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:11.780618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fbcce-9f17-45eb-b033-7cbcca2e3758 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:11.798654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:11.879249 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fbcce-9f17-45eb-b033-7cbcca2e3758 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:11.912518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1dfd-1a09-4218-afa3-a3fdf6222c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:11.913301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1dfd-1a09-4218-afa3-a3fdf6222c10 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:11.913584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1dfd-1a09-4218-afa3-a3fdf6222c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:11.913907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1dfd-1a09-4218-afa3-a3fdf6222c10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:11.924630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f1dfd-1a09-4218-afa3-a3fdf6222c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c35f1dfd-1a09-4218-afa3-a3fdf6222c10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:26:11.932229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:11.933391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:11.934625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 619/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:11.939488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e9f4-c154-4bf8-8b6f-f0e496fb589f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:12.035890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e9f4-c154-4bf8-8b6f-f0e496fb589f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:12.064225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:12.068984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:12.069634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:12.069916 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:12.070959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:12.071699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:12.072031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:12.073375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:12.081146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 631/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:12.087004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1dfd-1a09-4218-afa3-a3fdf6222c10 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:12.162880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:12.185150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1dfd-1a09-4218-afa3-a3fdf6222c10 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:12.217554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:12.218331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:12.218612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:12.218886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:12.229291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:12.231231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:12.247742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:12.248805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:12.249919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:12.249919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:12.249919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:12.249919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:12.249919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 620/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:12.254657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:12.350752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd03280-6192-47b8-9974-f731c01077b0 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:12.384504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:12.385159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:12.385441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:12.385717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:12.386429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:12.386733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:12.388118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:12.399583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 632/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:12.405396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:12.503348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b28136-4379-442b-8b25-95cdb9b3f69c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:12.527963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:12.535299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:12.536112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:12.536454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:12.536663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:12.544333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:12.545750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:26:12.561312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:12.562416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:12.563437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 621/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:12.568468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:12.627136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:12.669869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a8d44-e10c-478b-b769-37893f3dcb90 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:12.702366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:12.703030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:12.703312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:12.703588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:12.704467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:12.704780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:12.706219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:12.724987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 633/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jun 15 00:26:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:12.731158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:12.829788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3be51-4d96-4a09-a9ab-67696fae3472 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:12.863364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906767d-10bc-4a19-bd28-d0f5fc454f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:12.864049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906767d-10bc-4a19-bd28-d0f5fc454f8f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:12.864336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906767d-10bc-4a19-bd28-d0f5fc454f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:12.864610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906767d-10bc-4a19-bd28-d0f5fc454f8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:12.919117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:12.930823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906767d-10bc-4a19-bd28-d0f5fc454f8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:12.932289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906767d-10bc-4a19-bd28-d0f5fc454f8f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:13.026286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 622/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:26:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:26:13.032046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:13.127728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410d831-e700-4d6b-ab9b-3d3f69e262c1 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:13.141492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:13.162832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:13.163603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:13.163884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:13.164763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:13.174343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:13.175767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:13.192531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:13.193643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:13.194752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:13.194752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:13.194752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:13.194752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:13.194752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 634/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:13.200000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906767d-10bc-4a19-bd28-d0f5fc454f8f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:13.284505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:13.295532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906767d-10bc-4a19-bd28-d0f5fc454f8f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:13.327630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:13.328315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:13.328600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:13.328878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:13.329596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:13.329910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:13.331265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:13.342653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 623/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:13.348288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:13.444835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1606476-d540-47c0-a849-6852a52792bf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:13.477665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:13.478432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:13.478708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:13.478976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:13.485346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:13.486770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:26:13.499892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:13.500928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:13.501946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 635/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:13.506910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:13.607061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839611-c300-4c77-94b8-bc68b3d6f802 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:13.640206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124fce2-041c-43a4-926c-d03dcca32a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:13.640852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124fce2-041c-43a4-926c-d03dcca32a1b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:13.641131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124fce2-041c-43a4-926c-d03dcca32a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:13.641401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124fce2-041c-43a4-926c-d03dcca32a1b None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:13.642202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124fce2-041c-43a4-926c-d03dcca32a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:13.642508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124fce2-041c-43a4-926c-d03dcca32a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:13.643939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124fce2-041c-43a4-926c-d03dcca32a1b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:13.655545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 624/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:13.661754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:13.687429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:13.760289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48bea6-c994-43e3-ad13-b8989390b07c None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:13.792309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6d1c4-e575-43b8-a7ae-63218f7376fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:13.792939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d1c4-e575-43b8-a7ae-63218f7376fa None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:13.793220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d1c4-e575-43b8-a7ae-63218f7376fa None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:13.793489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d1c4-e575-43b8-a7ae-63218f7376fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:13.794301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d1c4-e575-43b8-a7ae-63218f7376fa None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=f6cc8de6532145799454b27e742259d9) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:13.794610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d1c4-e575-43b8-a7ae-63218f7376fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:13.796044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d1c4-e575-43b8-a7ae-63218f7376fa None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:13.801292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 636/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:26:13 2022] GET /identity/v3/role_assignments?user.id=f6cc8de6532145799454b27e742259d9&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:15.874689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15136f-7dd4-4114-ab4f-9b3c8f52f162 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:15.875326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15136f-7dd4-4114-ab4f-9b3c8f52f162 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:15.875326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15136f-7dd4-4114-ab4f-9b3c8f52f162 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:15.876667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 625/1261] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:15.881933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3722-b2f7-47f8-9fba-b40fba34c5a7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:15.884826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3722-b2f7-47f8-9fba-b40fba34c5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:15.884826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3722-b2f7-47f8-9fba-b40fba34c5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:15.899819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-178b3722-b2f7-47f8-9fba-b40fba34c5a7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:15.901012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-178b3722-b2f7-47f8-9fba-b40fba34c5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:15.964637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 637/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:15.986841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15136f-7dd4-4114-ab4f-9b3c8f52f162 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:15.998365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:16.086496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15136f-7dd4-4114-ab4f-9b3c8f52f162 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:16.126031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a394ed-4dc7-4059-853f-ebc7dfad1a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:16.126815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394ed-4dc7-4059-853f-ebc7dfad1a5b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:16.127097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394ed-4dc7-4059-853f-ebc7dfad1a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:16.127372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a394ed-4dc7-4059-853f-ebc7dfad1a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:16.138321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a394ed-4dc7-4059-853f-ebc7dfad1a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d9a394ed-4dc7-4059-853f-ebc7dfad1a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:26:16.145944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:16.147017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:16.148053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 626/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:16.153214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3722-b2f7-47f8-9fba-b40fba34c5a7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:16.171427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:16.249237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3722-b2f7-47f8-9fba-b40fba34c5a7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:16.281645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:16.282295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:16.282577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:16.282886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:16.283623 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:16.283946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:16.285299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:16.294776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 638/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:16.299479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a394ed-4dc7-4059-853f-ebc7dfad1a5b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:16.365433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:16.398941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a394ed-4dc7-4059-853f-ebc7dfad1a5b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:16.431201 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:16.431995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:16.432276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:16.432548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:16.443608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:16.453013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:16.462734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:16.463741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:16.464851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:16.464851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:16.464851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:16.464851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:16.464851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 627/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:16.469689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:16.549169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:16.567134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdcb60-8371-4493-8787-68b458c7e871 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:16.599409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:16.600090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:16.600368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:16.600641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:16.601382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:16.601686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:16.603034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:16.615683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 639/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:16.621981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:16.721753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67341335-e4fe-4361-b66c-7b46d4a26d3c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:16.741471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:16.758473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:16.759310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:16.759588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:16.759877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:16.767367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:16.768907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:26:16.783097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:16.784070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:16.785059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 628/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:16.790202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:16.892864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c17abc-e279-489a-9b71-e1c4908d0e59 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:16.925561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:16.926220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:16.926500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:16.926772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:16.927598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:16.927925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:16.929352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:16.938629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:16.947024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 640/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jun 15 00:26:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:16.952732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:17.050096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef1f3-0e54-4df5-9694-ab726ff62ed8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:17.081971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:17.082744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:17.083022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:17.083294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:17.093956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:17.095454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:17.113469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:17.114587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:17.115618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:17.115618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:17.115618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:17.115618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:17.115618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 629/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:17.120956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:17.219616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055101-dd98-41f3-a5c5-b080920946cf None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:17.254519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:17.255163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:17.255442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:17.255710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:17.256450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:17.256750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:17.258459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:17.269618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 641/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:17.275936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:17.306900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:17.373204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0782cf-b292-4ce0-be82-81aac079fa29 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:17.405554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:17.406326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:17.406603 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:17.406871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:17.413291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:17.415344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:26:17.429231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:17.430358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:17.431433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 630/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:17.436288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:17.493259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:17.533631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a016-30d9-4206-a262-f050d262de88 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:17.565811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ace404-cd23-4ae9-9eeb-5d1dc3f29f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:17.566451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ace404-cd23-4ae9-9eeb-5d1dc3f29f8b None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:17.566727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ace404-cd23-4ae9-9eeb-5d1dc3f29f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:17.566996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ace404-cd23-4ae9-9eeb-5d1dc3f29f8b None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:17.567772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ace404-cd23-4ae9-9eeb-5d1dc3f29f8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:17.568104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ace404-cd23-4ae9-9eeb-5d1dc3f29f8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:17.569629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ace404-cd23-4ae9-9eeb-5d1dc3f29f8b None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:17.582181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 642/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:17.588580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:17.678042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:17.686380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d59d-6223-4edb-bdef-4a84974eb257 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:17.719552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a5dcb-f74f-4f26-bd66-699f62fce284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:17.720457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a5dcb-f74f-4f26-bd66-699f62fce284 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:17.720739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a5dcb-f74f-4f26-bd66-699f62fce284 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:17.721017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a5dcb-f74f-4f26-bd66-699f62fce284 None admin] PATH_INFO: `/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/f6cc8de6532145799454b27e742259d9/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:17.723008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a5dcb-f74f-4f26-bd66-699f62fce284 None admin] RBAC: Authorizing `identity:create_grant(project_id=a09d802211fa462d87de5e87cf6dbb90, user_id=f6cc8de6532145799454b27e742259d9, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:17.724454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a5dcb-f74f-4f26-bd66-699f62fce284 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:17.838912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 631/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jun 15 00:26:17 2022] PUT /identity/v3/projects/a09d802211fa462d87de5e87cf6dbb90/users/f6cc8de6532145799454b27e742259d9/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:26:19.948813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7e97-c237-469e-b949-d9c8c942175e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:19.949404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7e97-c237-469e-b949-d9c8c942175e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:19.949404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7e97-c237-469e-b949-d9c8c942175e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:19.950703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 643/1274] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:19.955859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675f41-6561-41b6-9262-5be28792f8c3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:19.956339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675f41-6561-41b6-9262-5be28792f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:19.956439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675f41-6561-41b6-9262-5be28792f8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:19.972983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3e675f41-6561-41b6-9262-5be28792f8c3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:19.974161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e675f41-6561-41b6-9262-5be28792f8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:20.041413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 632/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:20.064670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d7e97-c237-469e-b949-d9c8c942175e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:20.171146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d7e97-c237-469e-b949-d9c8c942175e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:20.189710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:20.208647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717a997-a3e7-49fa-84ff-f0d735d94cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:20.209517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717a997-a3e7-49fa-84ff-f0d735d94cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:20.209797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717a997-a3e7-49fa-84ff-f0d735d94cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:20.210108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717a997-a3e7-49fa-84ff-f0d735d94cb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:20.222178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717a997-a3e7-49fa-84ff-f0d735d94cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-8717a997-a3e7-49fa-84ff-f0d735d94cb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:26:20.230124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:20.231527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:20.237801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 644/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jun 15 00:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:20.238640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675f41-6561-41b6-9262-5be28792f8c3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:20.328936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:20.347186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675f41-6561-41b6-9262-5be28792f8c3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:20.381706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:20.382383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:20.382665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:20.382938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:20.384595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:20.384903 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:20.386288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:20.396321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 633/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jun 15 00:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:20.402596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717a997-a3e7-49fa-84ff-f0d735d94cb7 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:20.505634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717a997-a3e7-49fa-84ff-f0d735d94cb7 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:20.540036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:20.540857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:20.541139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:20.541441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:20.552185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:20.553681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:20.570679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:20.572414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:20.573615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:20.573615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:20.573615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:20.573615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:20.573615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 645/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:20.578381 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:20.676236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497915db-516f-46ab-8117-9404d8a12921 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:20.709210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:20.709863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:20.710146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:20.710423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:20.711216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:20.711523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:20.712943 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:20.724629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 634/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:20.731149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:20.762601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:20.830766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9343f-e1af-4c56-88c0-d8547e85c96a None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:20.867330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:20.868700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:20.868979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:20.869251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] PATH_INFO: `/v3/users/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:20.876520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:20.878014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:26:20.892491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:20.893601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:20.894888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 646/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:20.899714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:20.903474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:20.997451 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e15883-2aa7-488a-8009-bcec5b364e8f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:21.030166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:21.030823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:21.031101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:21.031375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:21.032238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:21.032549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:21.033957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:21.050977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 635/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jun 15 00:26:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:21.056669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:21.143416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:21.153149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab03f2a-dc25-4779-b18c-cdf8c8c01cba None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:21.184896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d19ed-b702-4ecc-9c61-eed13e7bf148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:21.185543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d19ed-b702-4ecc-9c61-eed13e7bf148 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:21.186017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d19ed-b702-4ecc-9c61-eed13e7bf148 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:21.186459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d19ed-b702-4ecc-9c61-eed13e7bf148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:21.253834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d19ed-b702-4ecc-9c61-eed13e7bf148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:21.255291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d19ed-b702-4ecc-9c61-eed13e7bf148 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:21.341803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:21.351441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 647/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jun 15 00:26:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:26:21.357884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:21.417426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:21.454279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07443-2a49-45f7-9697-fa2ba64af5a3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:21.487251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:21.488049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:21.488330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:21.488601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:21.498397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:21.499861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:26:21.521452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:21.522492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:21.523602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:26:21.523602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:26:21.523602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:26:21.523602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:21.523602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 636/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:21.525699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d19ed-b702-4ecc-9c61-eed13e7bf148 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:21.619356 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d19ed-b702-4ecc-9c61-eed13e7bf148 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:21.652456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:21.653096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:21.653377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:21.653648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:21.654405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:21.654706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:21.656071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:21.666711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 648/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jun 15 00:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:21.672261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:21.773336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c84a-a252-4962-9104-74326bcd82e3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:21.786984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:21.807182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:21.807992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:21.808275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:21.808546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:21.815017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:21.816474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:26:21.831200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:21.832248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jun 15 00:26:21.833361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 637/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jun 15 00:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:21.838370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:21.889392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:21.937493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848e879-ee26-4bea-bc5a-56f8206b209e None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:21.973437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c37b4-ad15-4df0-a453-777da6413ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:21.974095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c37b4-ad15-4df0-a453-777da6413ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:21.974376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c37b4-ad15-4df0-a453-777da6413ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:21.974654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c37b4-ad15-4df0-a453-777da6413ca8 None admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:21.975438 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c37b4-ad15-4df0-a453-777da6413ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:21.975748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c37b4-ad15-4df0-a453-777da6413ca8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:21.977209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c37b4-ad15-4df0-a453-777da6413ca8 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:21.988866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 649/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jun 15 00:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:21.995385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:22.094165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c421bc3-e442-4dfc-ae62-38a264fe1ab3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:22.127920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7317c-fd13-4d26-8916-d95c87243a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:22.128601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7317c-fd13-4d26-8916-d95c87243a8d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:22.128881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7317c-fd13-4d26-8916-d95c87243a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:22.129152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7317c-fd13-4d26-8916-d95c87243a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:22.129962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7317c-fd13-4d26-8916-d95c87243a8d None admin] RBAC: Adding query filter params (role.id=5e07e6070ab24fe5b212f357d6ba3775, scope.project.id=a09d802211fa462d87de5e87cf6dbb90, user.id=f6cc8de6532145799454b27e742259d9) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:22.130270 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7317c-fd13-4d26-8916-d95c87243a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:22.131673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7317c-fd13-4d26-8916-d95c87243a8d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:22.137634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 638/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jun 15 00:26:21 2022] GET /identity/v3/role_assignments?user.id=f6cc8de6532145799454b27e742259d9&scope.project.id=a09d802211fa462d87de5e87cf6dbb90&role.id=5e07e6070ab24fe5b212f357d6ba3775 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:24.277356 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a4a0a-cdca-4953-b60c-bdc76849a15c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:24.277888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a4a0a-cdca-4953-b60c-bdc76849a15c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:24.278011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a4a0a-cdca-4953-b60c-bdc76849a15c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:24.279275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 650/1288] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:24.284476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab389-bff4-43cb-aa5b-8fa8597b1ad4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:24.284854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab389-bff4-43cb-aa5b-8fa8597b1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:24.285028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab389-bff4-43cb-aa5b-8fa8597b1ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:24.310370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b6dab389-bff4-43cb-aa5b-8fa8597b1ad4 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:24.315403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b6dab389-bff4-43cb-aa5b-8fa8597b1ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:24.346822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:24.381921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 639/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:24.404955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a4a0a-cdca-4953-b60c-bdc76849a15c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:24.503736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a4a0a-cdca-4953-b60c-bdc76849a15c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:24.515102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:24.538100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:24.538925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:24.539207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:24.539478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:24.540163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:24.541523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:24.553901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:24.559888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:24.561052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 651/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:26:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:24.563084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab389-bff4-43cb-aa5b-8fa8597b1ad4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:24.660215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab389-bff4-43cb-aa5b-8fa8597b1ad4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:24.692747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11138ec-eae7-48e7-8bd6-4a230ef8b319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:24.693406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11138ec-eae7-48e7-8bd6-4a230ef8b319 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:24.693768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11138ec-eae7-48e7-8bd6-4a230ef8b319 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:24.693988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11138ec-eae7-48e7-8bd6-4a230ef8b319 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:24.694695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11138ec-eae7-48e7-8bd6-4a230ef8b319 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:24.695005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11138ec-eae7-48e7-8bd6-4a230ef8b319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:24.696972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11138ec-eae7-48e7-8bd6-4a230ef8b319 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:24.701708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 640/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jun 15 00:26:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:24.707600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:24.806551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c534-8417-49cd-bed8-616a76ec6723 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:24.838967 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6723b-bb60-4e6d-bb4b-1e2cca3c748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:24.839629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6723b-bb60-4e6d-bb4b-1e2cca3c748a None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:24.839937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6723b-bb60-4e6d-bb4b-1e2cca3c748a None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:24.840230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6723b-bb60-4e6d-bb4b-1e2cca3c748a None admin] PATH_INFO: `/v3/services` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:24.840995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6723b-bb60-4e6d-bb4b-1e2cca3c748a None admin] RBAC: Adding query filter params (type=placement) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:24.841305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6723b-bb60-4e6d-bb4b-1e2cca3c748a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:24.842725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6723b-bb60-4e6d-bb4b-1e2cca3c748a None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:24.847098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 652/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jun 15 00:26:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:26.932789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1792-cebd-4983-bd89-8b1a221e0841 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:26.933342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1792-cebd-4983-bd89-8b1a221e0841 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:26.933342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd1792-cebd-4983-bd89-8b1a221e0841 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:26.934696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 641/1293] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:26.939728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bedc06-2073-4f07-ba17-8e8c01b605bb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:26.940135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bedc06-2073-4f07-ba17-8e8c01b605bb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:26.940313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bedc06-2073-4f07-ba17-8e8c01b605bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:26.957117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f1bedc06-2073-4f07-ba17-8e8c01b605bb None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:26.958296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f1bedc06-2073-4f07-ba17-8e8c01b605bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:26.987102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:27.023000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 653/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:27.045527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd1792-cebd-4983-bd89-8b1a221e0841 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:27.077291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:27.146799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd1792-cebd-4983-bd89-8b1a221e0841 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:27.178868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609143c-b731-481a-9750-cb91a53a73bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:27.179521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609143c-b731-481a-9750-cb91a53a73bf None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:27.179803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609143c-b731-481a-9750-cb91a53a73bf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:27.180112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609143c-b731-481a-9750-cb91a53a73bf None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:27.181346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609143c-b731-481a-9750-cb91a53a73bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:27.182693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609143c-b731-481a-9750-cb91a53a73bf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:27.283320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 642/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jun 15 00:26:27 2022] POST /identity/v3/services => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:26:29.376627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7947-42c0-46a3-b39d-b58dc6392e9a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:29.377199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7947-42c0-46a3-b39d-b58dc6392e9a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:29.377199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7947-42c0-46a3-b39d-b58dc6392e9a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:29.378577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 654/1296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:29.384494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713c19b-ff3e-4f4b-a59d-ca5f5bced72b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:29.384920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713c19b-ff3e-4f4b-a59d-ca5f5bced72b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:29.385088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713c19b-ff3e-4f4b-a59d-ca5f5bced72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:29.402199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4713c19b-ff3e-4f4b-a59d-ca5f5bced72b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:29.403407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4713c19b-ff3e-4f4b-a59d-ca5f5bced72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:29.473489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 643/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:29.496083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7947-42c0-46a3-b39d-b58dc6392e9a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:29.593881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7947-42c0-46a3-b39d-b58dc6392e9a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:29.627048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:29.627763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:29.628071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:29.628344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:29.628983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:29.630327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:29.642012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:29.643239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:29.647584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 655/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:26:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:29.649114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713c19b-ff3e-4f4b-a59d-ca5f5bced72b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:29.667037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:29.743805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713c19b-ff3e-4f4b-a59d-ca5f5bced72b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:29.776220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:29.776876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:29.777156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:29.777429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:29.778183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:29.778492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:29.779850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:29.784861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 644/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jun 15 00:26:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:29.791261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:29.822525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:29.888918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb77830-f274-4863-b03b-c35fdf872d67 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:29.921760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962794a1-8e25-4dbf-a2c4-9816954094ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:29.922420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962794a1-8e25-4dbf-a2c4-9816954094ba None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:29.922697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962794a1-8e25-4dbf-a2c4-9816954094ba None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:29.922969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962794a1-8e25-4dbf-a2c4-9816954094ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:29.923745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962794a1-8e25-4dbf-a2c4-9816954094ba None admin] RBAC: Adding query filter params (interface=public, service_id=f98021f56f0741379a9d3cd89788084e, region_id=RegionOne) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:29.924089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962794a1-8e25-4dbf-a2c4-9816954094ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:29.925463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962794a1-8e25-4dbf-a2c4-9816954094ba None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:29.930385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 656/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jun 15 00:26:29 2022] GET /identity/v3/endpoints?service_id=f98021f56f0741379a9d3cd89788084e&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:29.936730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:30.016164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:30.034151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854126f8-0339-4ef3-852b-aec03f4c6582 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:30.067673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e0ed7-2e53-46bc-84fb-d7c12c3833e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:30.068359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0ed7-2e53-46bc-84fb-d7c12c3833e6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:30.068645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0ed7-2e53-46bc-84fb-d7c12c3833e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:30.068922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0ed7-2e53-46bc-84fb-d7c12c3833e6 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:30.069594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e0ed7-2e53-46bc-84fb-d7c12c3833e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:30.071057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e0ed7-2e53-46bc-84fb-d7c12c3833e6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:30.077789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 645/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jun 15 00:26:29 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:26:32.178332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda35cb-00af-4bac-be51-12fd74571b7c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:32.178864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda35cb-00af-4bac-be51-12fd74571b7c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:32.178864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda35cb-00af-4bac-be51-12fd74571b7c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:32.180258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 657/1302] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:32.185322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a636800-1638-4ceb-8131-d16b6dbb49b6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:32.185791 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a636800-1638-4ceb-8131-d16b6dbb49b6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:32.185883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a636800-1638-4ceb-8131-d16b6dbb49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:32.202184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4a636800-1638-4ceb-8131-d16b6dbb49b6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:32.203351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4a636800-1638-4ceb-8131-d16b6dbb49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:32.268699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 646/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:26:32.291280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda35cb-00af-4bac-be51-12fd74571b7c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:32.382295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:32.389616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda35cb-00af-4bac-be51-12fd74571b7c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:32.422138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:32.422923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:32.423203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:32.423475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:32.424170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:32.425502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:26:32.437423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:26:32.438467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application with Lock( Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: ERROR keystone.server.flask.application Jun 15 00:26:32.439407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 658/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jun 15 00:26:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:26:32.444556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a636800-1638-4ceb-8131-d16b6dbb49b6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:32.519177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:32.540629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a636800-1638-4ceb-8131-d16b6dbb49b6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:32.573870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f85d85-d71c-4f9c-9499-bceca9872c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:32.574526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f85d85-d71c-4f9c-9499-bceca9872c65 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:32.574809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f85d85-d71c-4f9c-9499-bceca9872c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:32.575085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f85d85-d71c-4f9c-9499-bceca9872c65 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:32.575778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f85d85-d71c-4f9c-9499-bceca9872c65 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:26:32.576115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f85d85-d71c-4f9c-9499-bceca9872c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:32.577458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f85d85-d71c-4f9c-9499-bceca9872c65 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:32.582513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 647/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jun 15 00:26:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:26:32.588182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:32.685539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a806b3-ccaf-443c-b00b-096df0fc7906 None admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:32.717143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91738e0-5a85-45d0-b915-5d9654ef0da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:32.717724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91738e0-5a85-45d0-b915-5d9654ef0da2 None admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:32.718006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91738e0-5a85-45d0-b915-5d9654ef0da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:32.718280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91738e0-5a85-45d0-b915-5d9654ef0da2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:32.719019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91738e0-5a85-45d0-b915-5d9654ef0da2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:32.720420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91738e0-5a85-45d0-b915-5d9654ef0da2 None admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:32.855800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 659/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jun 15 00:26:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:26:42.579461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=30 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:42.850447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:10.125331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672dc70-1f17-4891-83f1-e695edabf821 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:10.125868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672dc70-1f17-4891-83f1-e695edabf821 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:10.126098 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672dc70-1f17-4891-83f1-e695edabf821 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:10.128014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 648/1307] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:10.133142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fb10f-4037-4db1-8eed-c924235fa92d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:10.136876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fb10f-4037-4db1-8eed-c924235fa92d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:10.136876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fb10f-4037-4db1-8eed-c924235fa92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:10.262789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9e0fb10f-4037-4db1-8eed-c924235fa92d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:10.264021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9e0fb10f-4037-4db1-8eed-c924235fa92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:10.492745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 660/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:10.534466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001261b8-b329-45ea-9b05-262b1773f096 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:10.534867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001261b8-b329-45ea-9b05-262b1773f096 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:10.535365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001261b8-b329-45ea-9b05-262b1773f096 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:10.537153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 649/1309] 10.222.0.17 () {54 vars in 964 bytes} [Wed Jun 15 00:32:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:32:10.550327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46def-8f9d-4e97-8094-f27ad3cb008e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:10.551009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46def-8f9d-4e97-8094-f27ad3cb008e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:10.551432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46def-8f9d-4e97-8094-f27ad3cb008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:10.691736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-94d46def-8f9d-4e97-8094-f27ad3cb008e None None] MFA Rules not processed for user `1eaffae68edd4031ac771310b7d645cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:10.693307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94d46def-8f9d-4e97-8094-f27ad3cb008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:10.719331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:10.794052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 661/1310] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Jun 15 00:32:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:10.802780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001261b8-b329-45ea-9b05-262b1773f096 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:10.804869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-001261b8-b329-45ea-9b05-262b1773f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:10.934070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001261b8-b329-45ea-9b05-262b1773f096 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:11.013898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069ebd1-7aa4-4742-9ac4-66aa68fbf3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:11.015066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ebd1-7aa4-4742-9ac4-66aa68fbf3dd service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:11.015522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ebd1-7aa4-4742-9ac4-66aa68fbf3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:11.016094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069ebd1-7aa4-4742-9ac4-66aa68fbf3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:11.018546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9069ebd1-7aa4-4742-9ac4-66aa68fbf3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:11.083325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:11.149332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069ebd1-7aa4-4742-9ac4-66aa68fbf3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:11.151539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069ebd1-7aa4-4742-9ac4-66aa68fbf3dd service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:11.192854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 650/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:32:13.645329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda8f16-17bb-4754-ae43-4295d6aa6d2e None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:13.645924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda8f16-17bb-4754-ae43-4295d6aa6d2e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:13.645924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda8f16-17bb-4754-ae43-4295d6aa6d2e None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:13.647249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 662/1312] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:13.652520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ebace-a716-47e5-9e1c-0b16f7ce0f92 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:13.652959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ebace-a716-47e5-9e1c-0b16f7ce0f92 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:13.653085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ebace-a716-47e5-9e1c-0b16f7ce0f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:13.739752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-065ebace-a716-47e5-9e1c-0b16f7ce0f92 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:13.741054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-065ebace-a716-47e5-9e1c-0b16f7ce0f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:13.846956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 651/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:13.898657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bf638-49db-41c9-8854-348eb3ee8284 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:13.898951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bf638-49db-41c9-8854-348eb3ee8284 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:13.899303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bf638-49db-41c9-8854-348eb3ee8284 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:13.900769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 663/1314] 10.222.0.17 () {54 vars in 964 bytes} [Wed Jun 15 00:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:13.906507 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40ac41-d5ae-4fb7-9351-3df7b0168510 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:13.906798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40ac41-d5ae-4fb7-9351-3df7b0168510 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:13.907078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40ac41-d5ae-4fb7-9351-3df7b0168510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:13.917542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:13.982190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5a40ac41-d5ae-4fb7-9351-3df7b0168510 None None] MFA Rules not processed for user `1eaffae68edd4031ac771310b7d645cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:13.983410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5a40ac41-d5ae-4fb7-9351-3df7b0168510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:14.059764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 652/1315] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Jun 15 00:32:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:32:14.069551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bf638-49db-41c9-8854-348eb3ee8284 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:14.071151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-811bf638-49db-41c9-8854-348eb3ee8284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:14.178302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bf638-49db-41c9-8854-348eb3ee8284 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:14.248004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:14.250462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d16ee-e798-4f91-93fb-4a356e94f919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:14.251097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d16ee-e798-4f91-93fb-4a356e94f919 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:14.252026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d16ee-e798-4f91-93fb-4a356e94f919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:14.252301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d16ee-e798-4f91-93fb-4a356e94f919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:14.253915 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-070d16ee-e798-4f91-93fb-4a356e94f919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:14.357603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d16ee-e798-4f91-93fb-4a356e94f919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:14.359017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d16ee-e798-4f91-93fb-4a356e94f919 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:14.377758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 664/1316] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:17.205894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367d78c-7b61-47bd-bd29-060faeef070c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:17.206443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367d78c-7b61-47bd-bd29-060faeef070c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:17.206443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367d78c-7b61-47bd-bd29-060faeef070c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:17.207799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 653/1317] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:17.212857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc793-9fa4-4e4d-836b-69605a924a43 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:17.213299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc793-9fa4-4e4d-836b-69605a924a43 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:17.213394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc793-9fa4-4e4d-836b-69605a924a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:17.276397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-926bc793-9fa4-4e4d-836b-69605a924a43 None None] MFA Rules not processed for user `9c716bbf92114911b27d0d40a4830e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:17.277597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-926bc793-9fa4-4e4d-836b-69605a924a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:17.329129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:17.372265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 665/1318] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:32:17.411882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367d78c-7b61-47bd-bd29-060faeef070c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:17.413447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3367d78c-7b61-47bd-bd29-060faeef070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:17.514951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367d78c-7b61-47bd-bd29-060faeef070c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:17.517649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:17.586785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a0ff-34ea-4fbb-aba4-4dd3684fc4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:17.587415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a0ff-34ea-4fbb-aba4-4dd3684fc4df service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:17.587692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a0ff-34ea-4fbb-aba4-4dd3684fc4df service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:17.587995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a0ff-34ea-4fbb-aba4-4dd3684fc4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:17.589699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5061a0ff-34ea-4fbb-aba4-4dd3684fc4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:17.692808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a0ff-34ea-4fbb-aba4-4dd3684fc4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:17.694217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a0ff-34ea-4fbb-aba4-4dd3684fc4df service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:17.711765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 654/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:20.686825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a90a4-b76b-4994-a624-8c9da7d3a270 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:20.687379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a90a4-b76b-4994-a624-8c9da7d3a270 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:20.687379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a90a4-b76b-4994-a624-8c9da7d3a270 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:20.688813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 666/1320] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:20.694110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45fa58-5345-4d84-af86-54f839276ad3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:20.694519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45fa58-5345-4d84-af86-54f839276ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:20.694662 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45fa58-5345-4d84-af86-54f839276ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:20.733071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:20.758874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5f45fa58-5345-4d84-af86-54f839276ad3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:20.760097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5f45fa58-5345-4d84-af86-54f839276ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:20.853939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 655/1321] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:20.892977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a90a4-b76b-4994-a624-8c9da7d3a270 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:20.894484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-695a90a4-b76b-4994-a624-8c9da7d3a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:20.994693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a90a4-b76b-4994-a624-8c9da7d3a270 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:21.065312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecece6-047e-4094-8c4d-1ab129a02fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:21.065947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecece6-047e-4094-8c4d-1ab129a02fde service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:21.066227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecece6-047e-4094-8c4d-1ab129a02fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:21.066500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecece6-047e-4094-8c4d-1ab129a02fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:21.068146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-07ecece6-047e-4094-8c4d-1ab129a02fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:21.075357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:21.174741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecece6-047e-4094-8c4d-1ab129a02fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:21.176197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecece6-047e-4094-8c4d-1ab129a02fde service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:21.193908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 667/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:24.373448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60355e-ac49-48f9-bfe2-b8bab5258e9d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:24.373983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60355e-ac49-48f9-bfe2-b8bab5258e9d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:24.373983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60355e-ac49-48f9-bfe2-b8bab5258e9d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:24.375552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 656/1323] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:24.381757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdccf00-96e9-4055-9d35-b4bcc368f2b3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:24.382424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdccf00-96e9-4055-9d35-b4bcc368f2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:24.382424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdccf00-96e9-4055-9d35-b4bcc368f2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:24.452281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2cdccf00-96e9-4055-9d35-b4bcc368f2b3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:24.453402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2cdccf00-96e9-4055-9d35-b4bcc368f2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:24.514273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:24.553154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 668/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:24.589546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60355e-ac49-48f9-bfe2-b8bab5258e9d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:24.591136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7e60355e-ac49-48f9-bfe2-b8bab5258e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:24.693936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60355e-ac49-48f9-bfe2-b8bab5258e9d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:24.706020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:24.769323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999456-cbed-4444-8c22-8602e672e974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:24.769971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999456-cbed-4444-8c22-8602e672e974 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:24.770258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999456-cbed-4444-8c22-8602e672e974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:24.770562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999456-cbed-4444-8c22-8602e672e974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:24.772301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f4999456-cbed-4444-8c22-8602e672e974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:24.878732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999456-cbed-4444-8c22-8602e672e974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:24.880188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999456-cbed-4444-8c22-8602e672e974 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:24.898000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 657/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:27.052998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41860aa-4c3e-4af2-a4dc-4a26233969c6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:27.053867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41860aa-4c3e-4af2-a4dc-4a26233969c6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:27.054149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41860aa-4c3e-4af2-a4dc-4a26233969c6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:27.055540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 669/1326] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:27.060871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe618d8-8096-4054-9493-79df6c3352a5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:27.061281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe618d8-8096-4054-9493-79df6c3352a5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:27.061428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe618d8-8096-4054-9493-79df6c3352a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:27.109232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:27.126819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1fe618d8-8096-4054-9493-79df6c3352a5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:27.128155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1fe618d8-8096-4054-9493-79df6c3352a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:27.229205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 658/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:27.265241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41860aa-4c3e-4af2-a4dc-4a26233969c6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:27.267406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c41860aa-4c3e-4af2-a4dc-4a26233969c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:27.382198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41860aa-4c3e-4af2-a4dc-4a26233969c6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:27.457572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a372f-e0c1-40f5-9267-150998dafb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:27.458214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a372f-e0c1-40f5-9267-150998dafb3f service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:27.458493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a372f-e0c1-40f5-9267-150998dafb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:27.458765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a372f-e0c1-40f5-9267-150998dafb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:27.460420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0e7a372f-e0c1-40f5-9267-150998dafb3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:27.477539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:27.579692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a372f-e0c1-40f5-9267-150998dafb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:27.581150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a372f-e0c1-40f5-9267-150998dafb3f service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:27.598777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 670/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:29.770818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832bd5-2937-4723-aab2-6076d1520b6b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:29.771338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832bd5-2937-4723-aab2-6076d1520b6b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:29.771434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38832bd5-2937-4723-aab2-6076d1520b6b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:29.772770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 659/1329] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:29.777830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a2d2-d664-46f2-8685-3c9b72275fc5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:29.778232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a2d2-d664-46f2-8685-3c9b72275fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:29.778388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217a2d2-d664-46f2-8685-3c9b72275fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:29.844006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c217a2d2-d664-46f2-8685-3c9b72275fc5 None None] MFA Rules not processed for user `9c716bbf92114911b27d0d40a4830e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:29.845766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c217a2d2-d664-46f2-8685-3c9b72275fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:29.909552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:29.940144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 671/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:29.977510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38832bd5-2937-4723-aab2-6076d1520b6b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:29.979047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38832bd5-2937-4723-aab2-6076d1520b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:30.109329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38832bd5-2937-4723-aab2-6076d1520b6b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:30.129657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:30.186237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c7b2-4fa6-49c3-ba76-b68128efa159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:30.186881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c7b2-4fa6-49c3-ba76-b68128efa159 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:30.187157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c7b2-4fa6-49c3-ba76-b68128efa159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:30.187425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c7b2-4fa6-49c3-ba76-b68128efa159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:30.189116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1ba4c7b2-4fa6-49c3-ba76-b68128efa159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:30.302153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c7b2-4fa6-49c3-ba76-b68128efa159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:30.303776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c7b2-4fa6-49c3-ba76-b68128efa159 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:30.322881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 660/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:32.899004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b7a1-72e3-4c23-85c2-2003f95c9342 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:32.899552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b7a1-72e3-4c23-85c2-2003f95c9342 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:32.899552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b7a1-72e3-4c23-85c2-2003f95c9342 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:32.900954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 672/1332] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:32.905963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274a66d-f3cc-48a6-b78e-604e592d714a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:32.906451 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274a66d-f3cc-48a6-b78e-604e592d714a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:32.906578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274a66d-f3cc-48a6-b78e-604e592d714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:32.967958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:32.971012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6274a66d-f3cc-48a6-b78e-604e592d714a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:32.972304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6274a66d-f3cc-48a6-b78e-604e592d714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:33.066872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 661/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:33.102982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433b7a1-72e3-4c23-85c2-2003f95c9342 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:33.104561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c433b7a1-72e3-4c23-85c2-2003f95c9342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:33.205012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433b7a1-72e3-4c23-85c2-2003f95c9342 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:33.277255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f6207-be09-40dc-81ca-ac9090a6231b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:33.277890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f6207-be09-40dc-81ca-ac9090a6231b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:33.278170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f6207-be09-40dc-81ca-ac9090a6231b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:33.278446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f6207-be09-40dc-81ca-ac9090a6231b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:33.280090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-225f6207-be09-40dc-81ca-ac9090a6231b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:33.305445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:33.386065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f6207-be09-40dc-81ca-ac9090a6231b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:33.387405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f6207-be09-40dc-81ca-ac9090a6231b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:33.405253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 673/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:35.542369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bde1-45fb-4c9d-ad6a-fda30cf364cd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:35.542908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bde1-45fb-4c9d-ad6a-fda30cf364cd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:35.542908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296bde1-45fb-4c9d-ad6a-fda30cf364cd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:35.544318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 662/1335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:35.549950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c010-6ff2-43cc-889c-9d66ba06ea3c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:35.550391 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c010-6ff2-43cc-889c-9d66ba06ea3c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:35.550516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c010-6ff2-43cc-889c-9d66ba06ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:35.612982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ef65c010-6ff2-43cc-889c-9d66ba06ea3c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:35.614182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ef65c010-6ff2-43cc-889c-9d66ba06ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:35.685263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:35.706465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 674/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:35.746601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296bde1-45fb-4c9d-ad6a-fda30cf364cd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:35.748213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3296bde1-45fb-4c9d-ad6a-fda30cf364cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:35.848758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296bde1-45fb-4c9d-ad6a-fda30cf364cd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:35.875890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:35.919796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818853-5097-4fce-8cb9-23b35e1e6d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:35.920460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818853-5097-4fce-8cb9-23b35e1e6d86 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:35.920737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818853-5097-4fce-8cb9-23b35e1e6d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:35.921007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818853-5097-4fce-8cb9-23b35e1e6d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:35.922635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-50818853-5097-4fce-8cb9-23b35e1e6d86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:36.026892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50818853-5097-4fce-8cb9-23b35e1e6d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:36.028336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50818853-5097-4fce-8cb9-23b35e1e6d86 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:36.046208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 663/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:38.700800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172f8e-89ab-4072-81cf-938494b34e27 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:38.701335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172f8e-89ab-4072-81cf-938494b34e27 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:38.701335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2172f8e-89ab-4072-81cf-938494b34e27 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:38.702716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 675/1338] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:38.708158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba036854-5ed6-4078-9856-1f2c56dc704b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:38.708571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba036854-5ed6-4078-9856-1f2c56dc704b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:38.708715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba036854-5ed6-4078-9856-1f2c56dc704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:38.772666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ba036854-5ed6-4078-9856-1f2c56dc704b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:38.773855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ba036854-5ed6-4078-9856-1f2c56dc704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:38.782545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:38.869102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 664/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:38.904600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2172f8e-89ab-4072-81cf-938494b34e27 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:38.906109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a2172f8e-89ab-4072-81cf-938494b34e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:39.006538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2172f8e-89ab-4072-81cf-938494b34e27 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:39.077382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead6a03-ed4c-4476-9cbb-7db90e0e9727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:39.078011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead6a03-ed4c-4476-9cbb-7db90e0e9727 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:39.078795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead6a03-ed4c-4476-9cbb-7db90e0e9727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:39.079072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead6a03-ed4c-4476-9cbb-7db90e0e9727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:39.080753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bead6a03-ed4c-4476-9cbb-7db90e0e9727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:39.116163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:39.187263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead6a03-ed4c-4476-9cbb-7db90e0e9727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:39.188719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead6a03-ed4c-4476-9cbb-7db90e0e9727 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:39.206711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 676/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:43.465439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f5f3f-67d0-4e3f-8ad6-ac3cd07f0aae None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:43.466375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f5f3f-67d0-4e3f-8ad6-ac3cd07f0aae None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:43.466738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f5f3f-67d0-4e3f-8ad6-ac3cd07f0aae None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:43.468321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 665/1341] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:43.474558 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bab3a-e3d1-486a-b015-b5e0c9aee05f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:43.475046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bab3a-e3d1-486a-b015-b5e0c9aee05f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:43.475366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bab3a-e3d1-486a-b015-b5e0c9aee05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:43.552437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cd7bab3a-e3d1-486a-b015-b5e0c9aee05f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:43.553784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cd7bab3a-e3d1-486a-b015-b5e0c9aee05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:43.646238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:43.659227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 677/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:43.698646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f5f3f-67d0-4e3f-8ad6-ac3cd07f0aae None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:43.700771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-be8f5f3f-67d0-4e3f-8ad6-ac3cd07f0aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:43.800315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f5f3f-67d0-4e3f-8ad6-ac3cd07f0aae None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:43.803826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16780af6-fc94-4e58-9cdb-4989f50c539e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:43.804494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16780af6-fc94-4e58-9cdb-4989f50c539e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:43.804777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16780af6-fc94-4e58-9cdb-4989f50c539e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:43.805059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16780af6-fc94-4e58-9cdb-4989f50c539e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:43.814355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16780af6-fc94-4e58-9cdb-4989f50c539e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:43.815768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16780af6-fc94-4e58-9cdb-4989f50c539e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:43.825027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 666/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:46.917058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cb39e-ae5a-42e6-befc-f0477095356d None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:46.917609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cb39e-ae5a-42e6-befc-f0477095356d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:46.917609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cb39e-ae5a-42e6-befc-f0477095356d None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:46.918985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 678/1344] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:46.924395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e07eb3-e07e-4172-aa7f-33f0525658c1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:46.924807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e07eb3-e07e-4172-aa7f-33f0525658c1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:46.925141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e07eb3-e07e-4172-aa7f-33f0525658c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:46.953657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-48e07eb3-e07e-4172-aa7f-33f0525658c1 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:46.954869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-48e07eb3-e07e-4172-aa7f-33f0525658c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:46.982898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:47.033354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 667/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:47.071396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cb39e-ae5a-42e6-befc-f0477095356d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:47.082502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cb39e-ae5a-42e6-befc-f0477095356d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:47.085951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334149a-4c88-4921-ba51-8441ef29ce7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:47.086572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334149a-4c88-4921-ba51-8441ef29ce7a service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:47.086940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334149a-4c88-4921-ba51-8441ef29ce7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:47.087211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334149a-4c88-4921-ba51-8441ef29ce7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:47.096166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334149a-4c88-4921-ba51-8441ef29ce7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:47.097580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334149a-4c88-4921-ba51-8441ef29ce7a service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:47.107317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 679/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:51.394155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db385f-73e4-4dc2-97f0-e08917d4afec None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:51.394676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db385f-73e4-4dc2-97f0-e08917d4afec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:51.394676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db385f-73e4-4dc2-97f0-e08917d4afec None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:51.396239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 668/1347] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:51.401398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed57bb-a5de-430a-b195-2701d2ae12cd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:51.401840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed57bb-a5de-430a-b195-2701d2ae12cd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:51.401957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed57bb-a5de-430a-b195-2701d2ae12cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:51.419118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cbed57bb-a5de-430a-b195-2701d2ae12cd None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:51.420329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cbed57bb-a5de-430a-b195-2701d2ae12cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:51.428045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 680/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:32:51.465869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db385f-73e4-4dc2-97f0-e08917d4afec None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:51.476689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db385f-73e4-4dc2-97f0-e08917d4afec None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:51.480253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cf967-20e8-4702-8b9a-06249ca50646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:51.480895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf967-20e8-4702-8b9a-06249ca50646 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:51.481178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf967-20e8-4702-8b9a-06249ca50646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:51.481456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf967-20e8-4702-8b9a-06249ca50646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:51.494680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cf967-20e8-4702-8b9a-06249ca50646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:51.496152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cf967-20e8-4702-8b9a-06249ca50646 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:51.513322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 669/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:56.473309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7559-64bc-4f16-9158-7e07d211b2cc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:56.473846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7559-64bc-4f16-9158-7e07d211b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:56.473846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b7559-64bc-4f16-9158-7e07d211b2cc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:56.476165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 681/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:56.482190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8aa9a-b572-44b7-8b62-239e3ffa76eb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:56.483214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8aa9a-b572-44b7-8b62-239e3ffa76eb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:56.483626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8aa9a-b572-44b7-8b62-239e3ffa76eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:56.555657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7fb8aa9a-b572-44b7-8b62-239e3ffa76eb None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:56.557071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7fb8aa9a-b572-44b7-8b62-239e3ffa76eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:56.643989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 670/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:32:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:01.011530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711f9c-96f6-4557-8585-1d3ed20cf3ad None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:01.012470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711f9c-96f6-4557-8585-1d3ed20cf3ad None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:01.012751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711f9c-96f6-4557-8585-1d3ed20cf3ad None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:01.014332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 682/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:01.019832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5fc1-09af-4ad3-b933-ff3694b0000c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:01.020410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5fc1-09af-4ad3-b933-ff3694b0000c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:01.020410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5fc1-09af-4ad3-b933-ff3694b0000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:01.039739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2e9a5fc1-09af-4ad3-b933-ff3694b0000c None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:01.040982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2e9a5fc1-09af-4ad3-b933-ff3694b0000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:01.050302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 671/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:33:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:01.414036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=13 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:02.577464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317c6d-b6ce-4191-91c0-9c946d91ed5a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:02.578082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317c6d-b6ce-4191-91c0-9c946d91ed5a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:02.578082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317c6d-b6ce-4191-91c0-9c946d91ed5a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:02.579514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 683/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:02.584344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27eed-8b28-47f3-adcd-46db1684c7c9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:02.584777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27eed-8b28-47f3-adcd-46db1684c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:02.584888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27eed-8b28-47f3-adcd-46db1684c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:02.603026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f4f27eed-8b28-47f3-adcd-46db1684c7c9 None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:02.604227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f4f27eed-8b28-47f3-adcd-46db1684c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:02.613185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 672/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:33:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:06.294546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa378-5990-431a-8ebc-e8c78ae0a567 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:06.295066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa378-5990-431a-8ebc-e8c78ae0a567 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:06.295255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa378-5990-431a-8ebc-e8c78ae0a567 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:06.296917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 684/1356] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:06.301989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fd3f9-6abb-460c-bd45-0bf026197e4f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:06.302437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fd3f9-6abb-460c-bd45-0bf026197e4f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:06.305589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fd3f9-6abb-460c-bd45-0bf026197e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:06.321014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-630fd3f9-6abb-460c-bd45-0bf026197e4f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:06.322355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-630fd3f9-6abb-460c-bd45-0bf026197e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:06.331129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 673/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:06.392920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114f90f-c3ec-4e61-97da-3b2eb589af15 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:06.393583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114f90f-c3ec-4e61-97da-3b2eb589af15 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:06.394083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114f90f-c3ec-4e61-97da-3b2eb589af15 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:06.395892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 685/1358] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jun 15 00:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:06.402672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d3e8d-d3f1-4341-a971-f1e01738dcfa None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:06.402961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d3e8d-d3f1-4341-a971-f1e01738dcfa None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:06.403231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d3e8d-d3f1-4341-a971-f1e01738dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:06.447417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:06.457287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-880d3e8d-d3f1-4341-a971-f1e01738dcfa None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:06.458723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-880d3e8d-d3f1-4341-a971-f1e01738dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:06.541256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 674/1359] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jun 15 00:33:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:06.550104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114f90f-c3ec-4e61-97da-3b2eb589af15 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:06.565499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114f90f-c3ec-4e61-97da-3b2eb589af15 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:06.571068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f688-8554-436f-b2ba-f6dc5ad34717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:06.571808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f688-8554-436f-b2ba-f6dc5ad34717 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:06.572231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f688-8554-436f-b2ba-f6dc5ad34717 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:06.572620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f688-8554-436f-b2ba-f6dc5ad34717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:06.582101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8f688-8554-436f-b2ba-f6dc5ad34717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:06.583869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8f688-8554-436f-b2ba-f6dc5ad34717 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:06.593607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 686/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:08.916959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4017c-5805-471f-8889-b860092f9702 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:08.917534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4017c-5805-471f-8889-b860092f9702 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:08.917534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4017c-5805-471f-8889-b860092f9702 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:08.919029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 675/1361] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:08.925447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6ed46-7087-450a-ab3b-7cab1ac66aaf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:08.925957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6ed46-7087-450a-ab3b-7cab1ac66aaf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:08.925957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6ed46-7087-450a-ab3b-7cab1ac66aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:08.945165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d3e6ed46-7087-450a-ab3b-7cab1ac66aaf None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:08.946418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d3e6ed46-7087-450a-ab3b-7cab1ac66aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:08.955963 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 687/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:09.001894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4017c-5805-471f-8889-b860092f9702 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:09.017267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4017c-5805-471f-8889-b860092f9702 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:09.022724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32c690-3c15-4779-9563-a78aff1f4ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:09.023365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32c690-3c15-4779-9563-a78aff1f4ad7 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:09.023644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32c690-3c15-4779-9563-a78aff1f4ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:09.023931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32c690-3c15-4779-9563-a78aff1f4ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:09.034320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32c690-3c15-4779-9563-a78aff1f4ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:09.035930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32c690-3c15-4779-9563-a78aff1f4ad7 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:09.046146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 676/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:11.613272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffcb5-f9f8-4052-b00b-e5842d4607cc None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:11.613779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffcb5-f9f8-4052-b00b-e5842d4607cc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:11.613971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffcb5-f9f8-4052-b00b-e5842d4607cc None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:11.615455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 688/1364] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:11.620728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8247dbe-2b42-43d4-9cef-788aba09adb7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:11.621128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8247dbe-2b42-43d4-9cef-788aba09adb7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:11.621279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8247dbe-2b42-43d4-9cef-788aba09adb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:11.639066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f8247dbe-2b42-43d4-9cef-788aba09adb7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:11.640320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f8247dbe-2b42-43d4-9cef-788aba09adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:11.648208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 677/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:11.695613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb3877-b2ba-4290-9ea1-6120189e59bb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:11.695844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb3877-b2ba-4290-9ea1-6120189e59bb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:11.696166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb3877-b2ba-4290-9ea1-6120189e59bb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:11.697830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 689/1366] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jun 15 00:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:11.703384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd368-5707-440a-96a4-b14eb4ed0426 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:11.710120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd368-5707-440a-96a4-b14eb4ed0426 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:11.710120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd368-5707-440a-96a4-b14eb4ed0426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:11.731182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d78bd368-5707-440a-96a4-b14eb4ed0426 None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:11.732795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d78bd368-5707-440a-96a4-b14eb4ed0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:11.744799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 678/1367] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jun 15 00:33:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:11.752817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb3877-b2ba-4290-9ea1-6120189e59bb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:11.780695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb3877-b2ba-4290-9ea1-6120189e59bb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:11.787098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a90373-475c-4fc7-b7b2-88cee9c4ce0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:11.788032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a90373-475c-4fc7-b7b2-88cee9c4ce0b service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:11.788407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a90373-475c-4fc7-b7b2-88cee9c4ce0b service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:11.788777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a90373-475c-4fc7-b7b2-88cee9c4ce0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:11.798566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a90373-475c-4fc7-b7b2-88cee9c4ce0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:11.800179 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a90373-475c-4fc7-b7b2-88cee9c4ce0b service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:11.809504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 690/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:14.131701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95427-c1f7-4723-bbe9-4fe4dca122a6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.132329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95427-c1f7-4723-bbe9-4fe4dca122a6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.132329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db95427-c1f7-4723-bbe9-4fe4dca122a6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.133641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 679/1369] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:14.139958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78cb8-0582-41e4-a3e3-abc99f9a51f7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.140753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78cb8-0582-41e4-a3e3-abc99f9a51f7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.141032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78cb8-0582-41e4-a3e3-abc99f9a51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.159490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8af78cb8-0582-41e4-a3e3-abc99f9a51f7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:14.160736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8af78cb8-0582-41e4-a3e3-abc99f9a51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:14.168890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 691/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:14.213853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95427-c1f7-4723-bbe9-4fe4dca122a6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:14.228182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db95427-c1f7-4723-bbe9-4fe4dca122a6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:14.234306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e613646-c542-4fc1-afd7-19e2ffe419b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:14.234966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613646-c542-4fc1-afd7-19e2ffe419b4 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.235248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613646-c542-4fc1-afd7-19e2ffe419b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.235522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e613646-c542-4fc1-afd7-19e2ffe419b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.244388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e613646-c542-4fc1-afd7-19e2ffe419b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:14.245968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e613646-c542-4fc1-afd7-19e2ffe419b4 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:14.255969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 680/1371] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:14.429030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62197-22cf-4b1a-aac7-b741419ffb59 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.429250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62197-22cf-4b1a-aac7-b741419ffb59 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.429540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62197-22cf-4b1a-aac7-b741419ffb59 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.430891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 692/1372] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:14.436119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c636-f1da-4aeb-8060-2a043d6196a9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.436408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c636-f1da-4aeb-8060-2a043d6196a9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.436720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c636-f1da-4aeb-8060-2a043d6196a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.456223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-06d6c636-f1da-4aeb-8060-2a043d6196a9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:14.457412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06d6c636-f1da-4aeb-8060-2a043d6196a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:14.466009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 681/1373] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:14.773252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dfa5-f5ed-4656-ae1c-6c10fefc2b82 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.773543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dfa5-f5ed-4656-ae1c-6c10fefc2b82 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.773822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4dfa5-f5ed-4656-ae1c-6c10fefc2b82 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.775365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 693/1374] 10.222.0.17 () {54 vars in 963 bytes} [Wed Jun 15 00:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:14.780515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32c33-38bc-41c4-98b6-d6a32747700c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.780801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32c33-38bc-41c4-98b6-d6a32747700c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.781079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32c33-38bc-41c4-98b6-d6a32747700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.834635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a1c32c33-38bc-41c4-98b6-d6a32747700c None None] MFA Rules not processed for user `4033fb5bc0624281a97a979a75ce13e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:14.835819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a1c32c33-38bc-41c4-98b6-d6a32747700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:14.899260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 682/1375] 10.222.0.17 () {58 vars in 1060 bytes} [Wed Jun 15 00:33:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:14.907402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4dfa5-f5ed-4656-ae1c-6c10fefc2b82 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:14.918396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4dfa5-f5ed-4656-ae1c-6c10fefc2b82 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:14.922629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c0b3-3bdd-4328-bb07-6b04e1c5f6e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:14.923254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c0b3-3bdd-4328-bb07-6b04e1c5f6e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.923532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c0b3-3bdd-4328-bb07-6b04e1c5f6e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.923805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c0b3-3bdd-4328-bb07-6b04e1c5f6e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.933427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6c0b3-3bdd-4328-bb07-6b04e1c5f6e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:14.934974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6c0b3-3bdd-4328-bb07-6b04e1c5f6e9 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:14.945486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 694/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:16.538655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3217-8d20-4515-80fd-4e6e59dbebee None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:16.539199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3217-8d20-4515-80fd-4e6e59dbebee None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:16.539199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3217-8d20-4515-80fd-4e6e59dbebee None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:16.540662 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 683/1377] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:16.547191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70305b-6e1a-429e-a189-a82d2093dacc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:16.547738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70305b-6e1a-429e-a189-a82d2093dacc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:16.547990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70305b-6e1a-429e-a189-a82d2093dacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:16.567630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1b70305b-6e1a-429e-a189-a82d2093dacc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:16.568891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1b70305b-6e1a-429e-a189-a82d2093dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:16.576920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 695/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:16.621820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde3217-8d20-4515-80fd-4e6e59dbebee None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:16.637433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde3217-8d20-4515-80fd-4e6e59dbebee None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:16.643117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b40837-18e6-43ae-b298-aaae046586e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:16.643785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40837-18e6-43ae-b298-aaae046586e9 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:16.644091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40837-18e6-43ae-b298-aaae046586e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:16.644366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40837-18e6-43ae-b298-aaae046586e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:16.653360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b40837-18e6-43ae-b298-aaae046586e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:16.655000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b40837-18e6-43ae-b298-aaae046586e9 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:16.659304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:16.666044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 684/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:18.929211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf932b-e471-4c1b-a016-aec4925ab670 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:18.929750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf932b-e471-4c1b-a016-aec4925ab670 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:18.929750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf932b-e471-4c1b-a016-aec4925ab670 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:18.931099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 696/1380] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:18.936217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6b855-4763-4543-ae5b-bbd3cc03dcd2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:18.936624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6b855-4763-4543-ae5b-bbd3cc03dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:18.936766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6b855-4763-4543-ae5b-bbd3cc03dcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:18.955274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-84d6b855-4763-4543-ae5b-bbd3cc03dcd2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:18.956485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-84d6b855-4763-4543-ae5b-bbd3cc03dcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:18.968242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 685/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:19.007675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf932b-e471-4c1b-a016-aec4925ab670 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:19.023448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf932b-e471-4c1b-a016-aec4925ab670 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:19.028905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6db58-0cf0-4147-ac93-24959e7adfe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:19.029641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6db58-0cf0-4147-ac93-24959e7adfe4 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:19.030015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6db58-0cf0-4147-ac93-24959e7adfe4 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:19.030421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6db58-0cf0-4147-ac93-24959e7adfe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:19.038883 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6db58-0cf0-4147-ac93-24959e7adfe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:19.040609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6db58-0cf0-4147-ac93-24959e7adfe4 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:19.050390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 697/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:21.298322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d855-6816-4ec5-b2d9-2a62d83272e8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:21.298851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d855-6816-4ec5-b2d9-2a62d83272e8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:21.298944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520d855-6816-4ec5-b2d9-2a62d83272e8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:21.300503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 686/1383] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:21.305560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525dd2-718e-4f4b-b303-d43f429cbd00 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:21.305961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525dd2-718e-4f4b-b303-d43f429cbd00 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:21.306122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525dd2-718e-4f4b-b303-d43f429cbd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:21.325100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-f7525dd2-718e-4f4b-b303-d43f429cbd00 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:21.327057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f7525dd2-718e-4f4b-b303-d43f429cbd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:21.335308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 698/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:21.377541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520d855-6816-4ec5-b2d9-2a62d83272e8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:21.394573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520d855-6816-4ec5-b2d9-2a62d83272e8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:21.400337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc47f0b-a9c3-4584-bd6d-14c445e7fe24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:21.401524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc47f0b-a9c3-4584-bd6d-14c445e7fe24 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:21.401900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc47f0b-a9c3-4584-bd6d-14c445e7fe24 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:21.402246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc47f0b-a9c3-4584-bd6d-14c445e7fe24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:21.412306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc47f0b-a9c3-4584-bd6d-14c445e7fe24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:21.414182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc47f0b-a9c3-4584-bd6d-14c445e7fe24 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:21.426268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 687/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:23.572386 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875127a-ffed-431c-beb0-19bf01a843bb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:23.573059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875127a-ffed-431c-beb0-19bf01a843bb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:23.573059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875127a-ffed-431c-beb0-19bf01a843bb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:23.574307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 699/1386] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:23.580576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57230ff5-9f05-401b-8f61-b46bbdd23c69 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:23.581012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57230ff5-9f05-401b-8f61-b46bbdd23c69 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:23.581286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57230ff5-9f05-401b-8f61-b46bbdd23c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:23.602865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-57230ff5-9f05-401b-8f61-b46bbdd23c69 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:23.604466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-57230ff5-9f05-401b-8f61-b46bbdd23c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:23.614317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 688/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:23.659799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875127a-ffed-431c-beb0-19bf01a843bb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:23.673791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875127a-ffed-431c-beb0-19bf01a843bb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:23.679138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b1c05-c51b-404c-ab24-7cb64b9a3258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:23.679771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b1c05-c51b-404c-ab24-7cb64b9a3258 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:23.680073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b1c05-c51b-404c-ab24-7cb64b9a3258 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:23.680352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b1c05-c51b-404c-ab24-7cb64b9a3258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:23.689597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b1c05-c51b-404c-ab24-7cb64b9a3258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:23.691235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b1c05-c51b-404c-ab24-7cb64b9a3258 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:23.701266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 700/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:26.014591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4c27-bc70-40e8-ae74-de279e6fed9b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:26.015138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4c27-bc70-40e8-ae74-de279e6fed9b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:26.015138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b4c27-bc70-40e8-ae74-de279e6fed9b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:26.016458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 689/1389] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:26.021576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8f02-06a5-409a-9af8-82b086faea9e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:26.022046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8f02-06a5-409a-9af8-82b086faea9e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:26.022175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8f02-06a5-409a-9af8-82b086faea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:26.044901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b69c8f02-06a5-409a-9af8-82b086faea9e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:26.047120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b69c8f02-06a5-409a-9af8-82b086faea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:26.057158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 701/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:26.111302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4c27-bc70-40e8-ae74-de279e6fed9b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:26.126286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b4c27-bc70-40e8-ae74-de279e6fed9b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:26.131729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f148698-7ad0-47b6-b579-d03e0b96183d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:26.132412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148698-7ad0-47b6-b579-d03e0b96183d service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:26.132704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148698-7ad0-47b6-b579-d03e0b96183d service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:26.132989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148698-7ad0-47b6-b579-d03e0b96183d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:26.142183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f148698-7ad0-47b6-b579-d03e0b96183d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:26.143836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f148698-7ad0-47b6-b579-d03e0b96183d service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:26.153613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 690/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:28.857449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6748405-4635-4b6b-98bd-6107f1104a59 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:28.858182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6748405-4635-4b6b-98bd-6107f1104a59 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:28.858182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6748405-4635-4b6b-98bd-6107f1104a59 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:28.859404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 702/1392] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:33:28.865284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26f91-ae9f-4ef5-99a1-a8048b696548 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:28.865837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26f91-ae9f-4ef5-99a1-a8048b696548 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:28.865957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26f91-ae9f-4ef5-99a1-a8048b696548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:28.890694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-50b26f91-ae9f-4ef5-99a1-a8048b696548 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:28.892209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-50b26f91-ae9f-4ef5-99a1-a8048b696548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:28.903848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 691/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:28.954656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6748405-4635-4b6b-98bd-6107f1104a59 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:28.969019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6748405-4635-4b6b-98bd-6107f1104a59 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:28.974624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f64d36-832a-4225-9693-4ea7b64dd0fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:28.975297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64d36-832a-4225-9693-4ea7b64dd0fe service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:28.975580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64d36-832a-4225-9693-4ea7b64dd0fe service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:28.975856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64d36-832a-4225-9693-4ea7b64dd0fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:28.984268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f64d36-832a-4225-9693-4ea7b64dd0fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:28.985861 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f64d36-832a-4225-9693-4ea7b64dd0fe service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:28.995757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 703/1394] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:30.416244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9369b1-fe7f-4c18-9adc-0a089b342d72 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:30.416798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9369b1-fe7f-4c18-9adc-0a089b342d72 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:30.416905 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9369b1-fe7f-4c18-9adc-0a089b342d72 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:30.418232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 692/1395] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:30.423568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9e70-05e1-456b-8ab3-0f711b23d40f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:30.424011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9e70-05e1-456b-8ab3-0f711b23d40f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:30.424182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9e70-05e1-456b-8ab3-0f711b23d40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:30.443206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a21e9e70-05e1-456b-8ab3-0f711b23d40f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:30.444361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a21e9e70-05e1-456b-8ab3-0f711b23d40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:30.452694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 704/1396] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:30.507482 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629fcd-4eb0-4a4d-a452-e0136ced72f0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:30.507769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629fcd-4eb0-4a4d-a452-e0136ced72f0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:30.508079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629fcd-4eb0-4a4d-a452-e0136ced72f0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:30.509448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 693/1397] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jun 15 00:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:30.515242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516202-7b29-4dbc-9778-3979135bd634 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:30.515534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516202-7b29-4dbc-9778-3979135bd634 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:30.515811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516202-7b29-4dbc-9778-3979135bd634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:30.564011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-82516202-7b29-4dbc-9778-3979135bd634 None None] MFA Rules not processed for user `17d6317775c343eaa9397254074647f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:30.565134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-82516202-7b29-4dbc-9778-3979135bd634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:30.621756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 705/1398] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jun 15 00:33:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:30.629855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629fcd-4eb0-4a4d-a452-e0136ced72f0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:30.642351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629fcd-4eb0-4a4d-a452-e0136ced72f0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:30.645764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ea1f7-9c0b-4a6a-8dd5-5bb98d5b8480 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d6317775c343eaa9397254074647f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:30.646416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ea1f7-9c0b-4a6a-8dd5-5bb98d5b8480 service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:30.646693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ea1f7-9c0b-4a6a-8dd5-5bb98d5b8480 service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:30.646960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ea1f7-9c0b-4a6a-8dd5-5bb98d5b8480 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:30.655882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ea1f7-9c0b-4a6a-8dd5-5bb98d5b8480 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:30.657307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ea1f7-9c0b-4a6a-8dd5-5bb98d5b8480 service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:30.666473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 694/1399] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:31.296748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497fcf-6888-4963-b70d-6e9db65d57c8 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:31.297050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497fcf-6888-4963-b70d-6e9db65d57c8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:31.297312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497fcf-6888-4963-b70d-6e9db65d57c8 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:31.298667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 706/1400] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:31.304221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f64dd-134d-4e73-8a88-1dccade18608 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:31.304510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f64dd-134d-4e73-8a88-1dccade18608 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:31.304788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f64dd-134d-4e73-8a88-1dccade18608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:31.325436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-315f64dd-134d-4e73-8a88-1dccade18608 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:31.325436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-315f64dd-134d-4e73-8a88-1dccade18608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:31.331551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 695/1401] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:31.376135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497fcf-6888-4963-b70d-6e9db65d57c8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:31.391201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497fcf-6888-4963-b70d-6e9db65d57c8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:31.396798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b00a6-e5e3-4e62-85dc-70c72b4f791e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:31.397434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b00a6-e5e3-4e62-85dc-70c72b4f791e service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:31.397720 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b00a6-e5e3-4e62-85dc-70c72b4f791e service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:31.397997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b00a6-e5e3-4e62-85dc-70c72b4f791e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:31.407204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b00a6-e5e3-4e62-85dc-70c72b4f791e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:31.411390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b00a6-e5e3-4e62-85dc-70c72b4f791e service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:31.418819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 707/1402] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:31.524785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376fb56-55a3-4353-a180-e825f13b4429 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:31.525244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376fb56-55a3-4353-a180-e825f13b4429 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:31.525350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376fb56-55a3-4353-a180-e825f13b4429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:31.575804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7376fb56-55a3-4353-a180-e825f13b4429 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:31.577570 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7376fb56-55a3-4353-a180-e825f13b4429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:31.647188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 696/1403] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:33:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:31.691248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274306bf-19e4-460a-a979-72395d12eee4 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:31.691248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274306bf-19e4-460a-a979-72395d12eee4 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:31.691873 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274306bf-19e4-460a-a979-72395d12eee4 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:31.692852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 708/1404] 10.222.0.17 () {54 vars in 942 bytes} [Wed Jun 15 00:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:31.699650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4d4b-1966-4976-90d8-1fa08beb9fa6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:31.699975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4d4b-1966-4976-90d8-1fa08beb9fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:31.700257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4d4b-1966-4976-90d8-1fa08beb9fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:31.758781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-65fc4d4b-1966-4976-90d8-1fa08beb9fa6 None None] MFA Rules not processed for user `7835f273e70a411fa7f8ee57395861f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:31.760006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-65fc4d4b-1966-4976-90d8-1fa08beb9fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:31.794448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:31.834390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 697/1405] 10.222.0.17 () {58 vars in 1039 bytes} [Wed Jun 15 00:33:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:31.843710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274306bf-19e4-460a-a979-72395d12eee4 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:31.851090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:31.857461 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274306bf-19e4-460a-a979-72395d12eee4 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:31.862582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436e317-45f6-44c1-9fff-796a95a812ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:31.863214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e317-45f6-44c1-9fff-796a95a812ed service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:31.863494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e317-45f6-44c1-9fff-796a95a812ed service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:31.863767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e317-45f6-44c1-9fff-796a95a812ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:31.871825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436e317-45f6-44c1-9fff-796a95a812ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:31.873913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436e317-45f6-44c1-9fff-796a95a812ed service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:31.882084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 709/1406] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:33:33.700762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221e9bd-4450-4a47-bf77-b1204a69f84c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:33.701337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221e9bd-4450-4a47-bf77-b1204a69f84c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:33.701337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221e9bd-4450-4a47-bf77-b1204a69f84c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:33.702909 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 698/1407] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:33.708562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf3466-2264-4845-a5da-e3ee2eda10cb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:33.709096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf3466-2264-4845-a5da-e3ee2eda10cb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:33.709096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf3466-2264-4845-a5da-e3ee2eda10cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:33.759308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-19cf3466-2264-4845-a5da-e3ee2eda10cb None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:33.759308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-19cf3466-2264-4845-a5da-e3ee2eda10cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:33.767979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 710/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:33.814097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221e9bd-4450-4a47-bf77-b1204a69f84c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:33.831055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221e9bd-4450-4a47-bf77-b1204a69f84c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:33.836820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d27f9-ab28-4707-93db-3689cd9e47d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:33.837545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d27f9-ab28-4707-93db-3689cd9e47d7 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:33.837829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d27f9-ab28-4707-93db-3689cd9e47d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:33.838104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d27f9-ab28-4707-93db-3689cd9e47d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:33.846964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d27f9-ab28-4707-93db-3689cd9e47d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:33.848582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d27f9-ab28-4707-93db-3689cd9e47d7 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:33.859037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 699/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:43.759741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=8 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:43.853732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=21 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:55.468467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f3d4-fd0a-496a-8421-a0a9bef67562 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:55.469009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f3d4-fd0a-496a-8421-a0a9bef67562 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:55.469009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f3d4-fd0a-496a-8421-a0a9bef67562 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:55.470424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 711/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Jun 15 00:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:55.475423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c4a1-df02-4b42-9214-ba88532f6356 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:55.475856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c4a1-df02-4b42-9214-ba88532f6356 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:55.475988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c4a1-df02-4b42-9214-ba88532f6356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:55.493442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a168c4a1-df02-4b42-9214-ba88532f6356 None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:55.494617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a168c4a1-df02-4b42-9214-ba88532f6356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:55.502807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 700/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jun 15 00:33:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:55.517384 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f0d74-ddf0-468d-b26f-9f0bff837dd0 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:55.517695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f0d74-ddf0-468d-b26f-9f0bff837dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:55.517969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f0d74-ddf0-468d-b26f-9f0bff837dd0 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:55.519298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 712/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Jun 15 00:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:55.523849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc90309-ee68-4b92-8070-f07b9a982b8d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:55.524170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc90309-ee68-4b92-8070-f07b9a982b8d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:55.524451 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc90309-ee68-4b92-8070-f07b9a982b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:55.542304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5bc90309-ee68-4b92-8070-f07b9a982b8d None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:55.543485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5bc90309-ee68-4b92-8070-f07b9a982b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:55.552575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 701/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jun 15 00:33:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:58.124074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c21b6-44d3-4c55-b429-e1a256769801 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:58.124605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c21b6-44d3-4c55-b429-e1a256769801 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:58.124605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c21b6-44d3-4c55-b429-e1a256769801 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:58.125974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:58.131226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd7007-848a-4586-83b6-3b97abe9247d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:58.131672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd7007-848a-4586-83b6-3b97abe9247d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:58.131780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd7007-848a-4586-83b6-3b97abe9247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:58.150363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6fbd7007-848a-4586-83b6-3b97abe9247d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:58.151661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6fbd7007-848a-4586-83b6-3b97abe9247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:58.161035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:58.203484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c21b6-44d3-4c55-b429-e1a256769801 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:58.219943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c21b6-44d3-4c55-b429-e1a256769801 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:58.225778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdb941-a868-4214-bf9c-84180426597a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:58.226837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb941-a868-4214-bf9c-84180426597a service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:58.227330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb941-a868-4214-bf9c-84180426597a service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:58.227609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdb941-a868-4214-bf9c-84180426597a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:58.237049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdb941-a868-4214-bf9c-84180426597a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:58.238638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdb941-a868-4214-bf9c-84180426597a service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:58.248180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 714/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:59.183381 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e721-fccb-4c91-b8dd-6545a37bba9e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:59.183970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e721-fccb-4c91-b8dd-6545a37bba9e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:59.183970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6e721-fccb-4c91-b8dd-6545a37bba9e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:59.185845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:33:59.190560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939cdcd-dc9e-4b31-8ae1-400fc4a86455 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:59.190939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939cdcd-dc9e-4b31-8ae1-400fc4a86455 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:59.191146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939cdcd-dc9e-4b31-8ae1-400fc4a86455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:59.208574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2939cdcd-dc9e-4b31-8ae1-400fc4a86455 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:59.209753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2939cdcd-dc9e-4b31-8ae1-400fc4a86455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:59.217359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:59.366632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e721-fccb-4c91-b8dd-6545a37bba9e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:59.381418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6e721-fccb-4c91-b8dd-6545a37bba9e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:59.387098 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5791d-3bf7-4b8a-a3ad-9037130b67a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:59.387736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5791d-3bf7-4b8a-a3ad-9037130b67a0 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:59.388066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5791d-3bf7-4b8a-a3ad-9037130b67a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:59.388345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5791d-3bf7-4b8a-a3ad-9037130b67a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:59.396446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5791d-3bf7-4b8a-a3ad-9037130b67a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:59.398013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5791d-3bf7-4b8a-a3ad-9037130b67a0 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:59.407303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 704/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:00.329581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f5e72-8952-4bf0-b4ff-085711f82bc6 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:00.330228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f5e72-8952-4bf0-b4ff-085711f82bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:00.330228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f5e72-8952-4bf0-b4ff-085711f82bc6 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:00.331551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:00.336691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a80f-3818-4d57-8876-971051e6d5a6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:00.337162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a80f-3818-4d57-8876-971051e6d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:00.337366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a80f-3818-4d57-8876-971051e6d5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:00.355395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7c90a80f-3818-4d57-8876-971051e6d5a6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:00.356713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7c90a80f-3818-4d57-8876-971051e6d5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:00.364726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:00.515726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f5e72-8952-4bf0-b4ff-085711f82bc6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:00.529854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f5e72-8952-4bf0-b4ff-085711f82bc6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:00.535214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f5146-4a49-4b8c-8f26-616dd8a7485a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:00.535839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5146-4a49-4b8c-8f26-616dd8a7485a service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:00.536145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5146-4a49-4b8c-8f26-616dd8a7485a service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:00.536421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5146-4a49-4b8c-8f26-616dd8a7485a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:00.544675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f5146-4a49-4b8c-8f26-616dd8a7485a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:00.546249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f5146-4a49-4b8c-8f26-616dd8a7485a service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:00.556086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 717/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:01.454706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bb2f-18cd-43e4-8bcf-1c43f4be563d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:01.455248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bb2f-18cd-43e4-8bcf-1c43f4be563d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:01.455248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890bb2f-18cd-43e4-8bcf-1c43f4be563d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:01.456648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:01.461394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691172-eb01-44fd-b45f-0820ce69554d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:01.461788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691172-eb01-44fd-b45f-0820ce69554d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:01.461949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691172-eb01-44fd-b45f-0820ce69554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:01.480162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-96691172-eb01-44fd-b45f-0820ce69554d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:01.481350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96691172-eb01-44fd-b45f-0820ce69554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:01.489185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:01.641590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890bb2f-18cd-43e4-8bcf-1c43f4be563d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:01.656427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890bb2f-18cd-43e4-8bcf-1c43f4be563d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:01.661755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d418c2-e6fd-45d1-b8ec-3e4ddad93251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:01.662382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d418c2-e6fd-45d1-b8ec-3e4ddad93251 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:01.662668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d418c2-e6fd-45d1-b8ec-3e4ddad93251 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:01.662944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d418c2-e6fd-45d1-b8ec-3e4ddad93251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:01.670990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d418c2-e6fd-45d1-b8ec-3e4ddad93251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:01.672601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d418c2-e6fd-45d1-b8ec-3e4ddad93251 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:01.681819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 707/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:02.584721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb20d26-ba13-4e42-bb1d-64058c94382f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:02.585291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb20d26-ba13-4e42-bb1d-64058c94382f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:02.585291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb20d26-ba13-4e42-bb1d-64058c94382f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:02.586638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:02.591991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02e95-6808-4e1a-a3b0-c9af0209d988 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:02.592426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02e95-6808-4e1a-a3b0-c9af0209d988 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:02.592542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02e95-6808-4e1a-a3b0-c9af0209d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:02.610652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-95f02e95-6808-4e1a-a3b0-c9af0209d988 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:02.611840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-95f02e95-6808-4e1a-a3b0-c9af0209d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:02.619465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:02.772626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb20d26-ba13-4e42-bb1d-64058c94382f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:02.787131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb20d26-ba13-4e42-bb1d-64058c94382f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:02.792524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a2c6f-b351-4603-974a-3c751137e145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:02.793145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2c6f-b351-4603-974a-3c751137e145 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:02.793955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2c6f-b351-4603-974a-3c751137e145 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:02.794234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2c6f-b351-4603-974a-3c751137e145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:02.802168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a2c6f-b351-4603-974a-3c751137e145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:02.803742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a2c6f-b351-4603-974a-3c751137e145 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:02.813331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 720/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:03.696203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9289e-3d81-4f26-8051-d6d98548efab None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:03.696772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9289e-3d81-4f26-8051-d6d98548efab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:03.696772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9289e-3d81-4f26-8051-d6d98548efab None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:03.698145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:03.702913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b725-6ed7-4207-81a1-50a02c17617c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:03.703319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b725-6ed7-4207-81a1-50a02c17617c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:03.703454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b725-6ed7-4207-81a1-50a02c17617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:03.720883 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3b00b725-6ed7-4207-81a1-50a02c17617c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:03.722054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3b00b725-6ed7-4207-81a1-50a02c17617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:03.729750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:03.879836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9289e-3d81-4f26-8051-d6d98548efab None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:03.894456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9289e-3d81-4f26-8051-d6d98548efab None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:03.899852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba212ecc-0f03-4e05-a117-db80edd3dd52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:03.900516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212ecc-0f03-4e05-a117-db80edd3dd52 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:03.900800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212ecc-0f03-4e05-a117-db80edd3dd52 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:03.901080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba212ecc-0f03-4e05-a117-db80edd3dd52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:03.909195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba212ecc-0f03-4e05-a117-db80edd3dd52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:03.910773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba212ecc-0f03-4e05-a117-db80edd3dd52 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:03.920522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 710/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:04.885050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958915de-ab0a-4548-82c5-3797d2fdd90c None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:04.885612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958915de-ab0a-4548-82c5-3797d2fdd90c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:04.885612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958915de-ab0a-4548-82c5-3797d2fdd90c None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:04.887817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:04.892826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc96f0-dd62-4086-b674-261536ba6661 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:04.893224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc96f0-dd62-4086-b674-261536ba6661 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:04.893376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc96f0-dd62-4086-b674-261536ba6661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:04.911693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-56fc96f0-dd62-4086-b674-261536ba6661 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:04.912925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-56fc96f0-dd62-4086-b674-261536ba6661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:04.920614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:05.069990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958915de-ab0a-4548-82c5-3797d2fdd90c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:05.084753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958915de-ab0a-4548-82c5-3797d2fdd90c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:05.089957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a6957-7b1d-4767-844b-02e8d63a8442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:05.090608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6957-7b1d-4767-844b-02e8d63a8442 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:05.090890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6957-7b1d-4767-844b-02e8d63a8442 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:05.091169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6957-7b1d-4767-844b-02e8d63a8442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:05.099104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a6957-7b1d-4767-844b-02e8d63a8442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:05.100709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a6957-7b1d-4767-844b-02e8d63a8442 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:05.109802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 723/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:06.048511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407859-762e-4bb4-ab5d-2594c8dfd5c8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:06.049040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407859-762e-4bb4-ab5d-2594c8dfd5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:06.049138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407859-762e-4bb4-ab5d-2594c8dfd5c8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:06.050476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:06.055183 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099748f0-7065-4ffa-b765-f9e65865ec55 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:06.055584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099748f0-7065-4ffa-b765-f9e65865ec55 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:06.055740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099748f0-7065-4ffa-b765-f9e65865ec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:06.073269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-099748f0-7065-4ffa-b765-f9e65865ec55 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:06.074970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-099748f0-7065-4ffa-b765-f9e65865ec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:06.082616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:06.231210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94407859-762e-4bb4-ab5d-2594c8dfd5c8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:06.245265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94407859-762e-4bb4-ab5d-2594c8dfd5c8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:06.251042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0de7d6-b70e-452d-bc5f-92dab4d6d168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:06.251660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0de7d6-b70e-452d-bc5f-92dab4d6d168 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:06.251965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0de7d6-b70e-452d-bc5f-92dab4d6d168 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:06.252238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0de7d6-b70e-452d-bc5f-92dab4d6d168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:06.260114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0de7d6-b70e-452d-bc5f-92dab4d6d168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:06.262540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0de7d6-b70e-452d-bc5f-92dab4d6d168 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:06.271627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 713/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:07.182934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc50c88-62c4-4cf1-b2ec-ea2809461939 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:07.183507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc50c88-62c4-4cf1-b2ec-ea2809461939 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:07.183622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc50c88-62c4-4cf1-b2ec-ea2809461939 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:07.184939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:07.189845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2e04-dabd-4727-a83a-840b4a65e72e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:07.190260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2e04-dabd-4727-a83a-840b4a65e72e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:07.190395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a2e04-dabd-4727-a83a-840b4a65e72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:07.207765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e89a2e04-dabd-4727-a83a-840b4a65e72e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:07.208986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e89a2e04-dabd-4727-a83a-840b4a65e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:07.217143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:07.366699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc50c88-62c4-4cf1-b2ec-ea2809461939 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:07.380776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc50c88-62c4-4cf1-b2ec-ea2809461939 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:07.386506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880450-971f-4862-9ad9-bb86428c5646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:07.387658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880450-971f-4862-9ad9-bb86428c5646 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:07.387957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880450-971f-4862-9ad9-bb86428c5646 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:07.388258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880450-971f-4862-9ad9-bb86428c5646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:07.396409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880450-971f-4862-9ad9-bb86428c5646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:07.397965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880450-971f-4862-9ad9-bb86428c5646 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:07.407712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 726/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:09.407355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aa208-ae7e-4ce8-acb0-bddac2a16b99 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:09.407880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aa208-ae7e-4ce8-acb0-bddac2a16b99 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:09.407880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054aa208-ae7e-4ce8-acb0-bddac2a16b99 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:09.409226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:09.414357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796509e-9489-4a4a-9f03-ad034f1ad839 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:09.414804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796509e-9489-4a4a-9f03-ad034f1ad839 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:09.414901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796509e-9489-4a4a-9f03-ad034f1ad839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:09.432148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0796509e-9489-4a4a-9f03-ad034f1ad839 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:09.433328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0796509e-9489-4a4a-9f03-ad034f1ad839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:09.441592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:09.480614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aa208-ae7e-4ce8-acb0-bddac2a16b99 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:09.491530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054aa208-ae7e-4ce8-acb0-bddac2a16b99 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:09.495076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b09f5-199b-4e60-afb5-a9792fb7c0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:09.498828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b09f5-199b-4e60-afb5-a9792fb7c0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:09.498828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b09f5-199b-4e60-afb5-a9792fb7c0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:09.498828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b09f5-199b-4e60-afb5-a9792fb7c0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:09.505750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b09f5-199b-4e60-afb5-a9792fb7c0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:09.507162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b09f5-199b-4e60-afb5-a9792fb7c0b3 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:09.517587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 716/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:11.784302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71174-c8b7-4ee5-82ca-cbc97c24345a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:11.784838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71174-c8b7-4ee5-82ca-cbc97c24345a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:11.784838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f71174-c8b7-4ee5-82ca-cbc97c24345a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:11.786486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:11.791763 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c078-d006-4628-8346-fdc6ca381fd4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:11.792182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c078-d006-4628-8346-fdc6ca381fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:11.792342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c078-d006-4628-8346-fdc6ca381fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:11.810398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3826c078-d006-4628-8346-fdc6ca381fd4 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:11.811580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3826c078-d006-4628-8346-fdc6ca381fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:11.819276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:11.857275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71174-c8b7-4ee5-82ca-cbc97c24345a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:11.867574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f71174-c8b7-4ee5-82ca-cbc97c24345a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:11.871034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82c27a-2252-4a57-b7fc-cf9bcd4a1d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:11.871647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82c27a-2252-4a57-b7fc-cf9bcd4a1d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:11.871947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82c27a-2252-4a57-b7fc-cf9bcd4a1d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:11.872225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82c27a-2252-4a57-b7fc-cf9bcd4a1d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:11.880815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82c27a-2252-4a57-b7fc-cf9bcd4a1d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:11.882229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82c27a-2252-4a57-b7fc-cf9bcd4a1d7d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:11.892195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 729/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:14.353608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a39c6-cac4-4269-916f-03504d2ad231 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:14.354177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a39c6-cac4-4269-916f-03504d2ad231 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:14.354177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a39c6-cac4-4269-916f-03504d2ad231 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:14.356087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:14.361444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432ee66-1c88-43a5-b373-f2493289ca7e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:14.361852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432ee66-1c88-43a5-b373-f2493289ca7e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:14.361998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432ee66-1c88-43a5-b373-f2493289ca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:14.379982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9432ee66-1c88-43a5-b373-f2493289ca7e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:14.381200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9432ee66-1c88-43a5-b373-f2493289ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:14.389172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:14.426813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a39c6-cac4-4269-916f-03504d2ad231 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:14.438008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a39c6-cac4-4269-916f-03504d2ad231 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:14.441485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4a7e4-a86a-4ca6-86f4-aa626967f874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:14.442144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a7e4-a86a-4ca6-86f4-aa626967f874 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:14.442422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a7e4-a86a-4ca6-86f4-aa626967f874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:14.442695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a7e4-a86a-4ca6-86f4-aa626967f874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:14.451456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4a7e4-a86a-4ca6-86f4-aa626967f874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:14.452901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4a7e4-a86a-4ca6-86f4-aa626967f874 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:14.462133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 719/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:16.678471 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35a38-c29f-4f7f-8786-6c03aed48be2 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:16.679008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35a38-c29f-4f7f-8786-6c03aed48be2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:16.679008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35a38-c29f-4f7f-8786-6c03aed48be2 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:16.680394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:16.686030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266052-0ad2-4d7a-bf3a-bebf0c7c8b8c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:16.686425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266052-0ad2-4d7a-bf3a-bebf0c7c8b8c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:16.686595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266052-0ad2-4d7a-bf3a-bebf0c7c8b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:16.704077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f5266052-0ad2-4d7a-bf3a-bebf0c7c8b8c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:16.705295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f5266052-0ad2-4d7a-bf3a-bebf0c7c8b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:16.713569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:16.753031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb35a38-c29f-4f7f-8786-6c03aed48be2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:16.763775 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb35a38-c29f-4f7f-8786-6c03aed48be2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:16.767280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c63d24-b60d-4a48-bb07-d351ea6c57fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:16.767899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c63d24-b60d-4a48-bb07-d351ea6c57fa service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:16.768200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c63d24-b60d-4a48-bb07-d351ea6c57fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:16.768476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c63d24-b60d-4a48-bb07-d351ea6c57fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:16.778791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c63d24-b60d-4a48-bb07-d351ea6c57fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:16.780237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c63d24-b60d-4a48-bb07-d351ea6c57fa service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:16.789299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 732/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:34:19.088205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84587738-df76-418b-acf9-a2685cbecc68 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:19.088747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84587738-df76-418b-acf9-a2685cbecc68 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:19.088747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84587738-df76-418b-acf9-a2685cbecc68 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:19.090129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:19.095160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51502c-4d80-48c5-8192-350046d1c6aa None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:19.095552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51502c-4d80-48c5-8192-350046d1c6aa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:19.095707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51502c-4d80-48c5-8192-350046d1c6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:19.112990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1f51502c-4d80-48c5-8192-350046d1c6aa None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:19.114157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1f51502c-4d80-48c5-8192-350046d1c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:19.122221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:19.159936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84587738-df76-418b-acf9-a2685cbecc68 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:19.161634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-84587738-df76-418b-acf9-a2685cbecc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:19.174364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84587738-df76-418b-acf9-a2685cbecc68 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:19.177893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1f713-7a67-4e29-affa-86cc115bd245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:19.178551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1f713-7a67-4e29-affa-86cc115bd245 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:19.178836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1f713-7a67-4e29-affa-86cc115bd245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:19.179114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1f713-7a67-4e29-affa-86cc115bd245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:19.188426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1f713-7a67-4e29-affa-86cc115bd245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:19.189911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1f713-7a67-4e29-affa-86cc115bd245 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:19.199840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 722/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:21.567675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f4a7-ba51-43b7-91c5-5991b4a7bc39 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:21.568289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f4a7-ba51-43b7-91c5-5991b4a7bc39 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:21.568289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f4a7-ba51-43b7-91c5-5991b4a7bc39 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:21.569629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:21.574994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ca883-e0e4-44f9-9ab8-19cc63407d00 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:21.575397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ca883-e0e4-44f9-9ab8-19cc63407d00 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:21.575550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ca883-e0e4-44f9-9ab8-19cc63407d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:21.593684 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ed1ca883-e0e4-44f9-9ab8-19cc63407d00 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:21.594894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ed1ca883-e0e4-44f9-9ab8-19cc63407d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:21.602876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:34:21.640825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686f4a7-ba51-43b7-91c5-5991b4a7bc39 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:21.651184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686f4a7-ba51-43b7-91c5-5991b4a7bc39 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:21.655513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc2a92-65eb-4468-9ab2-e8a540d57938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:21.656185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc2a92-65eb-4468-9ab2-e8a540d57938 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:21.656474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc2a92-65eb-4468-9ab2-e8a540d57938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:21.656749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc2a92-65eb-4468-9ab2-e8a540d57938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:21.665602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc2a92-65eb-4468-9ab2-e8a540d57938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:21.667030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc2a92-65eb-4468-9ab2-e8a540d57938 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:21.676252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 735/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:23.861842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d83d-fa41-465b-aefc-fe86d00ccdf7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:23.862376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d83d-fa41-465b-aefc-fe86d00ccdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:23.862376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d83d-fa41-465b-aefc-fe86d00ccdf7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:23.863798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:23.868991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965edc6-ea06-4e93-ba3d-751620187b4f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:23.869428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965edc6-ea06-4e93-ba3d-751620187b4f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:23.869540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965edc6-ea06-4e93-ba3d-751620187b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:23.875508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=70 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:23.888834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c965edc6-ea06-4e93-ba3d-751620187b4f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:23.890010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c965edc6-ea06-4e93-ba3d-751620187b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:23.897764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:23.934048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33d83d-fa41-465b-aefc-fe86d00ccdf7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:23.939411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=73 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:23.945058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33d83d-fa41-465b-aefc-fe86d00ccdf7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:23.949057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3bea3-30d5-4283-a451-6a676ea6430b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:23.949688 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3bea3-30d5-4283-a451-6a676ea6430b service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:23.949973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3bea3-30d5-4283-a451-6a676ea6430b service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:23.950251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3bea3-30d5-4283-a451-6a676ea6430b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:23.959016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3bea3-30d5-4283-a451-6a676ea6430b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:23.960466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3bea3-30d5-4283-a451-6a676ea6430b service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:23.970549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 725/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:26.112960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed19f9-e462-4f9b-9793-e87ea84126be None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:26.113525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed19f9-e462-4f9b-9793-e87ea84126be None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:26.113525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed19f9-e462-4f9b-9793-e87ea84126be None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:26.114870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:26.120817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e843-aa97-4a43-b024-11909acf7ccd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:26.121225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e843-aa97-4a43-b024-11909acf7ccd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:26.121377 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e843-aa97-4a43-b024-11909acf7ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:26.140443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2918e843-aa97-4a43-b024-11909acf7ccd None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:26.141623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2918e843-aa97-4a43-b024-11909acf7ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:26.149290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:26.186495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed19f9-e462-4f9b-9793-e87ea84126be None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:26.197066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed19f9-e462-4f9b-9793-e87ea84126be None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:26.200647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd20ca-b603-4df2-baaf-97c47598ca1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:26.201271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd20ca-b603-4df2-baaf-97c47598ca1d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:26.201553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd20ca-b603-4df2-baaf-97c47598ca1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:26.201825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd20ca-b603-4df2-baaf-97c47598ca1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:26.210498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd20ca-b603-4df2-baaf-97c47598ca1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:26.211936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd20ca-b603-4df2-baaf-97c47598ca1d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:26.221755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 738/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:28.358735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232522de-3b3f-45f0-b7cc-fb5d60e4ba0d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:28.359290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232522de-3b3f-45f0-b7cc-fb5d60e4ba0d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:28.359290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232522de-3b3f-45f0-b7cc-fb5d60e4ba0d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:28.360668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:28.365774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9729-e09f-4026-af9d-ab5adf077685 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:28.366171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9729-e09f-4026-af9d-ab5adf077685 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:28.366331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9729-e09f-4026-af9d-ab5adf077685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:28.383489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3e9b9729-e09f-4026-af9d-ab5adf077685 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:28.384718 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3e9b9729-e09f-4026-af9d-ab5adf077685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:28.392972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:28.429110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232522de-3b3f-45f0-b7cc-fb5d60e4ba0d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:28.439642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232522de-3b3f-45f0-b7cc-fb5d60e4ba0d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:28.443170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e79e-3630-462f-abec-e226854d5004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:28.443824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e79e-3630-462f-abec-e226854d5004 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:28.444136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e79e-3630-462f-abec-e226854d5004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:28.444412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e79e-3630-462f-abec-e226854d5004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:28.453739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4e79e-3630-462f-abec-e226854d5004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:28.455161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4e79e-3630-462f-abec-e226854d5004 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:28.465005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 728/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:30.581771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab335c4-f384-49a9-9aee-7f92d20a0a7f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:30.582343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab335c4-f384-49a9-9aee-7f92d20a0a7f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:30.582343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab335c4-f384-49a9-9aee-7f92d20a0a7f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:30.583672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:30.589020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d34b07-26ee-463b-b1c2-3eef353c5084 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:30.589449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d34b07-26ee-463b-b1c2-3eef353c5084 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:30.589569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d34b07-26ee-463b-b1c2-3eef353c5084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:30.606657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-88d34b07-26ee-463b-b1c2-3eef353c5084 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:30.607824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88d34b07-26ee-463b-b1c2-3eef353c5084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:30.615404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:30.651713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab335c4-f384-49a9-9aee-7f92d20a0a7f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:30.662270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab335c4-f384-49a9-9aee-7f92d20a0a7f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:30.665694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d898b8-b424-4cd1-a2e5-cd6b7a8e2ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:30.666308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d898b8-b424-4cd1-a2e5-cd6b7a8e2ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:30.666589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d898b8-b424-4cd1-a2e5-cd6b7a8e2ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:30.666859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d898b8-b424-4cd1-a2e5-cd6b7a8e2ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:30.675970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d898b8-b424-4cd1-a2e5-cd6b7a8e2ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:30.677382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d898b8-b424-4cd1-a2e5-cd6b7a8e2ac4 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:30.687052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 741/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:40.601652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=17 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:40.682375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=17 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:50.456936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbd3e-f0f1-4870-99d9-e6bda6df2c95 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.457493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbd3e-f0f1-4870-99d9-e6bda6df2c95 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.457493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbd3e-f0f1-4870-99d9-e6bda6df2c95 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.458873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 730/1471] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:50.464093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568122-eaa2-4611-b66b-39ab0f614d9e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.464518 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568122-eaa2-4611-b66b-39ab0f614d9e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.464653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568122-eaa2-4611-b66b-39ab0f614d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.482640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e5568122-eaa2-4611-b66b-39ab0f614d9e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.483761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e5568122-eaa2-4611-b66b-39ab0f614d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.491447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 742/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.544047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff46f-5ec9-4aa6-a31a-848b5ad773d5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.544339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff46f-5ec9-4aa6-a31a-848b5ad773d5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.544619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ff46f-5ec9-4aa6-a31a-848b5ad773d5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.545976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 731/1473] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jun 15 00:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:50.550581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf5a2-bb1f-4ce0-a4d6-ce7622149e1a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.550866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf5a2-bb1f-4ce0-a4d6-ce7622149e1a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.551143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daf5a2-bb1f-4ce0-a4d6-ce7622149e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.568921 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-11daf5a2-bb1f-4ce0-a4d6-ce7622149e1a None None] MFA Rules not processed for user `17d6317775c343eaa9397254074647f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.570091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-11daf5a2-bb1f-4ce0-a4d6-ce7622149e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.576425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 743/1474] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.583479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ff46f-5ec9-4aa6-a31a-848b5ad773d5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.594467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ff46f-5ec9-4aa6-a31a-848b5ad773d5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.597916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073d97b-afb4-4514-9521-1e95c8fe1d51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d6317775c343eaa9397254074647f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.598537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073d97b-afb4-4514-9521-1e95c8fe1d51 service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.598821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073d97b-afb4-4514-9521-1e95c8fe1d51 service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.599124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073d97b-afb4-4514-9521-1e95c8fe1d51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.608545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073d97b-afb4-4514-9521-1e95c8fe1d51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.609970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073d97b-afb4-4514-9521-1e95c8fe1d51 service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.619345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 732/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:34:52.818719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee31c7-7596-487c-8f0b-f05b7fcaf7f7 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.819271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee31c7-7596-487c-8f0b-f05b7fcaf7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.819271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee31c7-7596-487c-8f0b-f05b7fcaf7f7 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.820678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 744/1476] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:52.825825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3aa6d-f661-4626-a0f5-50f0cecd7489 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.826265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3aa6d-f661-4626-a0f5-50f0cecd7489 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.826372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3aa6d-f661-4626-a0f5-50f0cecd7489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.844223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2ae3aa6d-f661-4626-a0f5-50f0cecd7489 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.845415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2ae3aa6d-f661-4626-a0f5-50f0cecd7489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.853062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 733/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.876600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee31c7-7596-487c-8f0b-f05b7fcaf7f7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.888830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee31c7-7596-487c-8f0b-f05b7fcaf7f7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.893113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bc14b-131d-4211-aadb-7babb27e07f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.893736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bc14b-131d-4211-aadb-7babb27e07f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.894014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bc14b-131d-4211-aadb-7babb27e07f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.894312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bc14b-131d-4211-aadb-7babb27e07f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.895035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bc14b-131d-4211-aadb-7babb27e07f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.896804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-3c7bc14b-131d-4211-aadb-7babb27e07f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:34:52.896804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jun 15 00:34:52.896804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: Jun 15 00:34:52.897929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bc14b-131d-4211-aadb-7babb27e07f0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.917282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 745/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jun 15 00:34:52 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:55.081652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c394-bf3b-485d-a04c-cb1dba7c13e8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.082227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c394-bf3b-485d-a04c-cb1dba7c13e8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.082227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c394-bf3b-485d-a04c-cb1dba7c13e8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.083556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 734/1479] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:34:55.088787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd3f2-a699-4ed9-9e14-3ab85b972b55 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.089231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd3f2-a699-4ed9-9e14-3ab85b972b55 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.089337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd3f2-a699-4ed9-9e14-3ab85b972b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.106693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b59dd3f2-a699-4ed9-9e14-3ab85b972b55 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:55.107934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b59dd3f2-a699-4ed9-9e14-3ab85b972b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:55.115524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 746/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:55.157686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c394-bf3b-485d-a04c-cb1dba7c13e8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:55.171721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c394-bf3b-485d-a04c-cb1dba7c13e8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:55.177030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979dd7e-2eec-4fdc-93a2-b2239fbbadad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:55.177654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979dd7e-2eec-4fdc-93a2-b2239fbbadad service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.177932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979dd7e-2eec-4fdc-93a2-b2239fbbadad service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.178202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979dd7e-2eec-4fdc-93a2-b2239fbbadad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.186620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979dd7e-2eec-4fdc-93a2-b2239fbbadad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:55.188305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979dd7e-2eec-4fdc-93a2-b2239fbbadad service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:55.198172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 735/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:57.461218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664ca58-6d6e-4490-b7c5-d6451341c09a None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:57.461813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664ca58-6d6e-4490-b7c5-d6451341c09a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:57.461813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664ca58-6d6e-4490-b7c5-d6451341c09a None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:57.463155 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 747/1482] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:57.468222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acfdf0-4266-4d35-aeec-dcd672b519ef None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:57.468615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acfdf0-4266-4d35-aeec-dcd672b519ef None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:57.468769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acfdf0-4266-4d35-aeec-dcd672b519ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:57.485813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d4acfdf0-4266-4d35-aeec-dcd672b519ef None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:57.486978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d4acfdf0-4266-4d35-aeec-dcd672b519ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:57.495010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 736/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:57.530434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664ca58-6d6e-4490-b7c5-d6451341c09a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:57.540951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664ca58-6d6e-4490-b7c5-d6451341c09a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:57.544414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8649fb-2002-4f87-b284-24052f49cd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:57.545045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8649fb-2002-4f87-b284-24052f49cd5e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:57.545313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8649fb-2002-4f87-b284-24052f49cd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:57.545588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8649fb-2002-4f87-b284-24052f49cd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:57.554269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8649fb-2002-4f87-b284-24052f49cd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:57.555679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8649fb-2002-4f87-b284-24052f49cd5e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:57.565331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 748/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:59.729369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c06a-b314-48e7-b07b-6bf4db5a19a3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:59.729915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c06a-b314-48e7-b07b-6bf4db5a19a3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:59.730004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137c06a-b314-48e7-b07b-6bf4db5a19a3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:59.731356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 737/1485] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:59.736761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa218c-3f23-4842-ba89-aedac0413c51 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:59.737192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa218c-3f23-4842-ba89-aedac0413c51 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:59.737318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa218c-3f23-4842-ba89-aedac0413c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:59.754973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-45aa218c-3f23-4842-ba89-aedac0413c51 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:59.756185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-45aa218c-3f23-4842-ba89-aedac0413c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:59.764109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 749/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:59.802544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137c06a-b314-48e7-b07b-6bf4db5a19a3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:59.813029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137c06a-b314-48e7-b07b-6bf4db5a19a3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:59.816448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de540e8-ba9f-4c90-9180-8a448117ba88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:59.817072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de540e8-ba9f-4c90-9180-8a448117ba88 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:59.817353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de540e8-ba9f-4c90-9180-8a448117ba88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:59.817623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de540e8-ba9f-4c90-9180-8a448117ba88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:59.826307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de540e8-ba9f-4c90-9180-8a448117ba88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:59.827712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de540e8-ba9f-4c90-9180-8a448117ba88 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:59.836893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 738/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:02.048054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d26d7-c3ce-4393-a75e-6cdcefdc176b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.048686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d26d7-c3ce-4393-a75e-6cdcefdc176b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.048686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d26d7-c3ce-4393-a75e-6cdcefdc176b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.050010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 750/1488] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:35:02.055178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830280-738d-4740-b346-b35e8e4c5a03 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.055620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830280-738d-4740-b346-b35e8e4c5a03 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.055728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830280-738d-4740-b346-b35e8e4c5a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.074044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2d830280-738d-4740-b346-b35e8e4c5a03 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:02.075225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2d830280-738d-4740-b346-b35e8e4c5a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:02.082874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 739/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:02.122088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d26d7-c3ce-4393-a75e-6cdcefdc176b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:02.132594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d26d7-c3ce-4393-a75e-6cdcefdc176b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:02.136971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249a850-0d67-4813-93c2-332b1cb3a0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:02.137588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a850-0d67-4813-93c2-332b1cb3a0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.137870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a850-0d67-4813-93c2-332b1cb3a0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.138142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a850-0d67-4813-93c2-332b1cb3a0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.146811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a850-0d67-4813-93c2-332b1cb3a0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:02.148269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a850-0d67-4813-93c2-332b1cb3a0d1 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:02.157529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 751/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:04.659637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d2915-2bd1-4a4d-83e9-eb5c96eda004 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.660249 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d2915-2bd1-4a4d-83e9-eb5c96eda004 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.660249 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d2915-2bd1-4a4d-83e9-eb5c96eda004 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.661572 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 740/1491] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jun 15 00:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:35:04.666661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297ab6-ff05-4778-aacc-aba714d6920f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.667053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297ab6-ff05-4778-aacc-aba714d6920f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.667207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d297ab6-ff05-4778-aacc-aba714d6920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.684464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0d297ab6-ff05-4778-aacc-aba714d6920f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:04.685650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0d297ab6-ff05-4778-aacc-aba714d6920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.693300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 752/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jun 15 00:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:04.732765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d2915-2bd1-4a4d-83e9-eb5c96eda004 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:04.743350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d2915-2bd1-4a4d-83e9-eb5c96eda004 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:04.747383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa724-00c9-4caa-9892-671afa4da358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:04.748075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa724-00c9-4caa-9892-671afa4da358 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.748360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa724-00c9-4caa-9892-671afa4da358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.748635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa724-00c9-4caa-9892-671afa4da358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.757479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa724-00c9-4caa-9892-671afa4da358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:04.758897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa724-00c9-4caa-9892-671afa4da358 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:04.769035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 741/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:14.679415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=33 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:14.764990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=33 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:36.641404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed730f-4a21-4496-ad4c-21e097771066 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:36.642019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed730f-4a21-4496-ad4c-21e097771066 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:36.642019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed730f-4a21-4496-ad4c-21e097771066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:36.660531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-35ed730f-4a21-4496-ad4c-21e097771066 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:36.661723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-35ed730f-4a21-4496-ad4c-21e097771066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:36.669475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 753/1494] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:36.678667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e163c-c843-4b94-9e06-c6691ed624d6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:36.679173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e163c-c843-4b94-9e06-c6691ed624d6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:36.679276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e163c-c843-4b94-9e06-c6691ed624d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:36.697130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-236e163c-c843-4b94-9e06-c6691ed624d6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:36.698318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-236e163c-c843-4b94-9e06-c6691ed624d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:36.706879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 742/1495] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:36.712099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed730f-4a21-4496-ad4c-21e097771066 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:36.721682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed730f-4a21-4496-ad4c-21e097771066 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:36.726221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:36.726866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:36.727149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:36.727423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:36.728252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:36.728518 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:36.729557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:36:36.729557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jun 15 00:36:36.729557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: Jun 15 00:36:36.731031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:36.744216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 754/1496] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:36:36.752343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e163c-c843-4b94-9e06-c6691ed624d6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:36.762409 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e163c-c843-4b94-9e06-c6691ed624d6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:36.766958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:36.769945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:36.769945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:36.769945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:36.769945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:36.770604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:36:36.770604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: warnings.warn(msg) Jun 15 00:36:36.770604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: Jun 15 00:36:36.772479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:36.865232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 743/1497] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:36 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:36.869498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:36.879301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b06ec7-69af-4c03-8a90-8344cf788d63 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:36.934251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:36.934837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:36.935120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:36.935411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:36.936103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:36.937108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:36:36.937108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jun 15 00:36:36.937108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: Jun 15 00:36:36.938315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:37.023668 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 755/1498] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:36 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:37.027786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:37.037784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b0fb2-040a-4fa9-a19a-bcdad32b12e3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:37.042281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:37.042925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.043203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.043472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.044220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:37.045207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:36:37.045207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: warnings.warn(msg) Jun 15 00:36:37.045207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: Jun 15 00:36:37.046077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:37.058930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 744/1499] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:37.062885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:37.073235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518432f-5ef8-41d0-8ff2-08510ec8990f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:37.077746 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13b233-e1c0-4bde-8c10-7817362fd024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:37.078495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b233-e1c0-4bde-8c10-7817362fd024 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.078780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b233-e1c0-4bde-8c10-7817362fd024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.079052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b233-e1c0-4bde-8c10-7817362fd024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.079762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13b233-e1c0-4bde-8c10-7817362fd024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:37.080793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-1d13b233-e1c0-4bde-8c10-7817362fd024 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:36:37.080793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jun 15 00:36:37.080793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: Jun 15 00:36:37.081654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13b233-e1c0-4bde-8c10-7817362fd024 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:37.094338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 756/1500] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:37.098084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:37.107382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9601bd-4eee-4a24-bf38-dafca6a50ddf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:37.111762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756613e-b3e1-47a8-9738-785054d719bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:37.112636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756613e-b3e1-47a8-9738-785054d719bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.112914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756613e-b3e1-47a8-9738-785054d719bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.113182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756613e-b3e1-47a8-9738-785054d719bc admin admin] PATH_INFO: `/v3/projects/412198ae70144e40b330dcdcd096d0b3/users/55e8f66a4d9f46c9b4be570dfd45c326/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.127948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756613e-b3e1-47a8-9738-785054d719bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=412198ae70144e40b330dcdcd096d0b3, user_id=55e8f66a4d9f46c9b4be570dfd45c326, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:37.128962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-5756613e-b3e1-47a8-9738-785054d719bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:36:37.128962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: warnings.warn(msg) Jun 15 00:36:37.128962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: Jun 15 00:36:37.130874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756613e-b3e1-47a8-9738-785054d719bc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:37.201597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 745/1501] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:37 2022] PUT /identity/v3/projects/412198ae70144e40b330dcdcd096d0b3/users/55e8f66a4d9f46c9b4be570dfd45c326/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:37.212662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c021-a88e-4f17-aed5-e628cd7111bf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.213037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c021-a88e-4f17-aed5-e628cd7111bf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.213370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982c021-a88e-4f17-aed5-e628cd7111bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.239688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b982c021-a88e-4f17-aed5-e628cd7111bf None None] MFA Rules not processed for user `55e8f66a4d9f46c9b4be570dfd45c326`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:37.241428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b982c021-a88e-4f17-aed5-e628cd7111bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:37.305869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 757/1502] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:37.319334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d9b2-7448-4d58-a7ed-af5e5c4a706c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.319629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d9b2-7448-4d58-a7ed-af5e5c4a706c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.319928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9d9b2-7448-4d58-a7ed-af5e5c4a706c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.321323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 746/1503] 10.222.0.17 () {54 vars in 963 bytes} [Wed Jun 15 00:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:36:37.325996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7e7f-169a-48fd-b65e-bbdcbad8ef1c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.326564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7e7f-169a-48fd-b65e-bbdcbad8ef1c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.326564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7e7f-169a-48fd-b65e-bbdcbad8ef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.343996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b6db7e7f-169a-48fd-b65e-bbdcbad8ef1c None None] MFA Rules not processed for user `4033fb5bc0624281a97a979a75ce13e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:37.345178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b6db7e7f-169a-48fd-b65e-bbdcbad8ef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:37.388784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:37.396058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 758/1504] 10.222.0.17 () {58 vars in 1060 bytes} [Wed Jun 15 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:37.403798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9d9b2-7448-4d58-a7ed-af5e5c4a706c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:37.414694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9d9b2-7448-4d58-a7ed-af5e5c4a706c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:37.418281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa313-ae47-4d7a-9001-156ce5e4e64e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:37.418889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa313-ae47-4d7a-9001-156ce5e4e64e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.419170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa313-ae47-4d7a-9001-156ce5e4e64e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.419472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa313-ae47-4d7a-9001-156ce5e4e64e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.427888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fa313-ae47-4d7a-9001-156ce5e4e64e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:37.429988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fa313-ae47-4d7a-9001-156ce5e4e64e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:37.438646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 747/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:37.479637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3b79b-0d98-4ae7-b47e-86384e6d3b99 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.479958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3b79b-0d98-4ae7-b47e-86384e6d3b99 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.480242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3b79b-0d98-4ae7-b47e-86384e6d3b99 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.481524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 759/1506] 10.222.0.17 () {52 vars in 829 bytes} [Wed Jun 15 00:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:36:37.484940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa313-ae47-4d7a-9001-156ce5e4e64e service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:37.545350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa313-ae47-4d7a-9001-156ce5e4e64e service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:37.549813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:37.550665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.550949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.551223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] PATH_INFO: `/v3/users/55e8f66a4d9f46c9b4be570dfd45c326` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.552417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e8f66a4d9f46c9b4be570dfd45c326)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:37.554039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:36:37.554039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: warnings.warn(msg) Jun 15 00:36:37.554039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: Jun 15 00:36:37.555250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:37.725473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e8f66a4d9f46c9b4be570dfd45c326'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:37.792035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e8f66a4d9f46c9b4be570dfd45c326'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:37.810326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e8f66a4d9f46c9b4be570dfd45c326'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:37.811090 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e8f66a4d9f46c9b4be570dfd45c326'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:37.821083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:37.825157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e8f66a4d9f46c9b4be570dfd45c326'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:37.831237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 748/1507] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:37 2022] DELETE /identity/v3/users/55e8f66a4d9f46c9b4be570dfd45c326 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:37.836152 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bf14-5802-427f-bacc-9771eb109064 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.836651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bf14-5802-427f-bacc-9771eb109064 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.836765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bf14-5802-427f-bacc-9771eb109064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.854422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4c01bf14-5802-427f-bacc-9771eb109064 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:37.855646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4c01bf14-5802-427f-bacc-9771eb109064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:37.915114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 760/1508] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:37.924847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:37.929118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:37.982429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c7329-344e-4949-a379-dc211ac98dfe admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:37.985935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5a050-9dd7-44f3-b598-ebc45de0c42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:37.986573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5a050-9dd7-44f3-b598-ebc45de0c42d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:37.986859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5a050-9dd7-44f3-b598-ebc45de0c42d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:37.987138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5a050-9dd7-44f3-b598-ebc45de0c42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:37.995937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5a050-9dd7-44f3-b598-ebc45de0c42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:37.997368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5a050-9dd7-44f3-b598-ebc45de0c42d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:38.006555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 749/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:38.514971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01bf14-5802-427f-bacc-9771eb109064 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:38.516425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4c01bf14-5802-427f-bacc-9771eb109064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:38.528154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01bf14-5802-427f-bacc-9771eb109064 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:38.547449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:38.547449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:38.547449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:38.547449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] PATH_INFO: `/v3/projects/412198ae70144e40b330dcdcd096d0b3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:38.547812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=412198ae70144e40b330dcdcd096d0b3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:38.547812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:36:38.547812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jun 15 00:36:38.547812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: Jun 15 00:36:38.547812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:38.658104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412198ae70144e40b330dcdcd096d0b3', 'request_id': 'req-5bf5578c-892b-424c-a2a8-eb28ed4bff72'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:38.664016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412198ae70144e40b330dcdcd096d0b3', 'request_id': 'req-5bf5578c-892b-424c-a2a8-eb28ed4bff72'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:38.677025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412198ae70144e40b330dcdcd096d0b3', 'request_id': 'req-5bf5578c-892b-424c-a2a8-eb28ed4bff72'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:38.769140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] The token cache is being invalidate because project 412198ae70144e40b330dcdcd096d0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:38.769369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:38.770116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5bf5578c-892b-424c-a2a8-eb28ed4bff72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:38.771667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 761/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:38 2022] DELETE /identity/v3/projects/412198ae70144e40b330dcdcd096d0b3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:48.002538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=29 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:48.765675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:12.669035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c0542-70a3-4dd0-9cc2-d4676547a761 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:12.669627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c0542-70a3-4dd0-9cc2-d4676547a761 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:12.669627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c0542-70a3-4dd0-9cc2-d4676547a761 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:12.671064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:38:12.676086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bba0c2-9283-4ec3-8c13-3ea208cc5f72 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:12.676612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bba0c2-9283-4ec3-8c13-3ea208cc5f72 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:12.676893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bba0c2-9283-4ec3-8c13-3ea208cc5f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:12.695522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a9bba0c2-9283-4ec3-8c13-3ea208cc5f72 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:12.696765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a9bba0c2-9283-4ec3-8c13-3ea208cc5f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:12.756662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:12.924989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c0542-70a3-4dd0-9cc2-d4676547a761 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:12.927222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cf9c0542-70a3-4dd0-9cc2-d4676547a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:12.999516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c0542-70a3-4dd0-9cc2-d4676547a761 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:13.005392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcef28-00b6-4c9e-89dd-f2aed1847178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:13.006021 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcef28-00b6-4c9e-89dd-f2aed1847178 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:13.006301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcef28-00b6-4c9e-89dd-f2aed1847178 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:13.006574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcef28-00b6-4c9e-89dd-f2aed1847178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:13.014965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcef28-00b6-4c9e-89dd-f2aed1847178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:13.016630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcef28-00b6-4c9e-89dd-f2aed1847178 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:13.026109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 751/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:13.887551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6575-49c9-4738-ac6f-014b9659dcf1 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:13.888128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6575-49c9-4738-ac6f-014b9659dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:13.888128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6575-49c9-4738-ac6f-014b9659dcf1 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:13.889486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:38:13.894950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe7ba0-4f74-4f1b-b05d-90eb986ea61a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:13.895346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe7ba0-4f74-4f1b-b05d-90eb986ea61a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:13.895506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe7ba0-4f74-4f1b-b05d-90eb986ea61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:13.913805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-12fe7ba0-4f74-4f1b-b05d-90eb986ea61a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:13.914993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-12fe7ba0-4f74-4f1b-b05d-90eb986ea61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:13.922691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:14.075220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6575-49c9-4738-ac6f-014b9659dcf1 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:14.089830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6575-49c9-4738-ac6f-014b9659dcf1 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:14.095130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10992df9-2423-476e-969a-8bf01127ea91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:14.095752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10992df9-2423-476e-969a-8bf01127ea91 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:14.096070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10992df9-2423-476e-969a-8bf01127ea91 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:14.096348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10992df9-2423-476e-969a-8bf01127ea91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:14.104239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10992df9-2423-476e-969a-8bf01127ea91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:14.105837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10992df9-2423-476e-969a-8bf01127ea91 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:14.115008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 764/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:14.840974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2c79-4803-449d-af16-95f269fe6698 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:14.841262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2c79-4803-449d-af16-95f269fe6698 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:14.841543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e2c79-4803-449d-af16-95f269fe6698 None None] PATH_INFO: `/v3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:14.842864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 753/1517] 10.222.0.30 () {54 vars in 925 bytes} [Wed Jun 15 00:38:14 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:38:14.849411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358097f-447a-4d17-b47b-60ccf63e1b08 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:14.849716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358097f-447a-4d17-b47b-60ccf63e1b08 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:14.849974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358097f-447a-4d17-b47b-60ccf63e1b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:14.867296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4358097f-447a-4d17-b47b-60ccf63e1b08 None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:14.868512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4358097f-447a-4d17-b47b-60ccf63e1b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:14.927547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 765/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Jun 15 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:38:23.908148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=37 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:24.126843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ebc0-6c21-4904-b381-962bc6e2c65a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:24.127134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ebc0-6c21-4904-b381-962bc6e2c65a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:24.127417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ebc0-6c21-4904-b381-962bc6e2c65a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:24.128812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 754/1519] 10.222.0.17 () {54 vars in 960 bytes} [Wed Jun 15 00:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:38:24.133822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f7ed-1852-4888-b04f-2ae9de260c57 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:24.134276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f7ed-1852-4888-b04f-2ae9de260c57 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:24.134366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289f7ed-1852-4888-b04f-2ae9de260c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:24.154253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6289f7ed-1852-4888-b04f-2ae9de260c57 None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:24.155448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6289f7ed-1852-4888-b04f-2ae9de260c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:24.164446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 766/1520] 10.222.0.17 () {58 vars in 1057 bytes} [Wed Jun 15 00:38:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:24.171522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5ebc0-6c21-4904-b381-962bc6e2c65a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:24.184411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5ebc0-6c21-4904-b381-962bc6e2c65a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:24.189238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c0817-ebd6-4311-92fa-f4a50c3aecd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:24.189852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c0817-ebd6-4311-92fa-f4a50c3aecd9 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:24.190136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c0817-ebd6-4311-92fa-f4a50c3aecd9 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:24.190411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c0817-ebd6-4311-92fa-f4a50c3aecd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:24.198498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c0817-ebd6-4311-92fa-f4a50c3aecd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:24.200107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c0817-ebd6-4311-92fa-f4a50c3aecd9 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:24.209939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 755/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:25.388758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22a52-60b5-49c9-a320-4d8fb1df1bcb None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:25.389297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22a52-60b5-49c9-a320-4d8fb1df1bcb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:25.389297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22a52-60b5-49c9-a320-4d8fb1df1bcb None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:25.390648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:38:25.395321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573071e3-51db-4ac4-941e-9331e8c13f1b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:25.395754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573071e3-51db-4ac4-941e-9331e8c13f1b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:25.395927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573071e3-51db-4ac4-941e-9331e8c13f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:25.413840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-573071e3-51db-4ac4-941e-9331e8c13f1b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:25.415009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-573071e3-51db-4ac4-941e-9331e8c13f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:25.422726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:25.576067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22a52-60b5-49c9-a320-4d8fb1df1bcb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:25.589967 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22a52-60b5-49c9-a320-4d8fb1df1bcb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:25.595232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a04c4-d58c-40bd-bb85-7ffd0ea9bc39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:25.595850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a04c4-d58c-40bd-bb85-7ffd0ea9bc39 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:25.596162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a04c4-d58c-40bd-bb85-7ffd0ea9bc39 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:25.596439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a04c4-d58c-40bd-bb85-7ffd0ea9bc39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:25.604821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a04c4-d58c-40bd-bb85-7ffd0ea9bc39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:25.606407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a04c4-d58c-40bd-bb85-7ffd0ea9bc39 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:25.616344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 768/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:26.476024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe316aa-73a6-419c-a73e-abb172a01cc4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:26.476551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe316aa-73a6-419c-a73e-abb172a01cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:26.476551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe316aa-73a6-419c-a73e-abb172a01cc4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:26.477923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:38:26.482769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482e8a-f145-4a5a-9872-662c3b41f298 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:26.483211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482e8a-f145-4a5a-9872-662c3b41f298 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:26.483309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482e8a-f145-4a5a-9872-662c3b41f298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:26.501133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-96482e8a-f145-4a5a-9872-662c3b41f298 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:26.502408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96482e8a-f145-4a5a-9872-662c3b41f298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:26.511431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:26.662914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe316aa-73a6-419c-a73e-abb172a01cc4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:26.677296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe316aa-73a6-419c-a73e-abb172a01cc4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:26.682563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df254ebd-7bd4-4f6f-af70-27987659223d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:26.683188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254ebd-7bd4-4f6f-af70-27987659223d service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:26.683465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254ebd-7bd4-4f6f-af70-27987659223d service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:26.683739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254ebd-7bd4-4f6f-af70-27987659223d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:26.691548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df254ebd-7bd4-4f6f-af70-27987659223d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:26.693858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df254ebd-7bd4-4f6f-af70-27987659223d service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:26.702964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 758/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:30.660239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b35bb-18cc-412a-8bc8-cdfa57092af5 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:30.660748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b35bb-18cc-412a-8bc8-cdfa57092af5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:30.660748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b35bb-18cc-412a-8bc8-cdfa57092af5 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:30.662126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:38:30.667119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1217fc-60a6-4fa2-838b-6a0d895245d3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:30.667534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1217fc-60a6-4fa2-838b-6a0d895245d3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:30.667704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1217fc-60a6-4fa2-838b-6a0d895245d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:30.685115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3e1217fc-60a6-4fa2-838b-6a0d895245d3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:30.686300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e1217fc-60a6-4fa2-838b-6a0d895245d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:30.694607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:30.730534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b35bb-18cc-412a-8bc8-cdfa57092af5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:30.732261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-978b35bb-18cc-412a-8bc8-cdfa57092af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:30.788138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b35bb-18cc-412a-8bc8-cdfa57092af5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:30.791593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d01e0-ee88-4d83-b991-81e751bd9e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:30.792261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d01e0-ee88-4d83-b991-81e751bd9e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:30.792538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d01e0-ee88-4d83-b991-81e751bd9e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:30.792809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d01e0-ee88-4d83-b991-81e751bd9e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:30.801408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d01e0-ee88-4d83-b991-81e751bd9e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:30.802842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d01e0-ee88-4d83-b991-81e751bd9e8d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:30.807592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:30.812158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 771/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:32.901192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7699af-d063-4071-b1df-7a631f3f4bd2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:32.901749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7699af-d063-4071-b1df-7a631f3f4bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:32.901749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7699af-d063-4071-b1df-7a631f3f4bd2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:32.903089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:38:32.908305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ac89-3b17-41c9-b0f8-261d064ce42d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:32.908705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ac89-3b17-41c9-b0f8-261d064ce42d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:32.908867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ac89-3b17-41c9-b0f8-261d064ce42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:32.927532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d291ac89-3b17-41c9-b0f8-261d064ce42d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:32.928754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d291ac89-3b17-41c9-b0f8-261d064ce42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:32.936458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:32.971149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7699af-d063-4071-b1df-7a631f3f4bd2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:32.982089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7699af-d063-4071-b1df-7a631f3f4bd2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:32.985575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29c46b-082e-4f30-9d05-02ce2f08d396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:32.986192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c46b-082e-4f30-9d05-02ce2f08d396 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:32.986469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c46b-082e-4f30-9d05-02ce2f08d396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:32.986740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c46b-082e-4f30-9d05-02ce2f08d396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:32.996036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c46b-082e-4f30-9d05-02ce2f08d396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:32.997380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c46b-082e-4f30-9d05-02ce2f08d396 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:33.006421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 761/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:36.557686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf071a-b62c-406e-83da-ace0eec72808 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:36.558217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf071a-b62c-406e-83da-ace0eec72808 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:36.558217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf071a-b62c-406e-83da-ace0eec72808 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:36.559575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:38:36.564773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f581b-15ec-4203-b264-1bf0e9dcb354 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:36.565187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f581b-15ec-4203-b264-1bf0e9dcb354 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:36.565355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f581b-15ec-4203-b264-1bf0e9dcb354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:36.583845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c74f581b-15ec-4203-b264-1bf0e9dcb354 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:36.585052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c74f581b-15ec-4203-b264-1bf0e9dcb354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:36.592992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:36.858701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf071a-b62c-406e-83da-ace0eec72808 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:36.860394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9edf071a-b62c-406e-83da-ace0eec72808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:36.916315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf071a-b62c-406e-83da-ace0eec72808 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:36.919742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2f603-7686-4117-b0a6-ce1a40f1ecb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:36.920446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f603-7686-4117-b0a6-ce1a40f1ecb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:36.924444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f603-7686-4117-b0a6-ce1a40f1ecb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:36.924444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f603-7686-4117-b0a6-ce1a40f1ecb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:36.930473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2f603-7686-4117-b0a6-ce1a40f1ecb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:36.931946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2f603-7686-4117-b0a6-ce1a40f1ecb1 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:36.941159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 774/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:39.077124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201467-deb8-4874-9346-ca3205c7c5d0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:39.077743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201467-deb8-4874-9346-ca3205c7c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:39.077743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201467-deb8-4874-9346-ca3205c7c5d0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:39.079093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:38:39.084263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0235-8367-4806-856c-7f5eaafb8897 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:39.084722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0235-8367-4806-856c-7f5eaafb8897 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:39.084828 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0235-8367-4806-856c-7f5eaafb8897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:39.102766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e21c0235-8367-4806-856c-7f5eaafb8897 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:39.104031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e21c0235-8367-4806-856c-7f5eaafb8897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:39.111755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:38:39.373072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c201467-deb8-4874-9346-ca3205c7c5d0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:39.374812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2c201467-deb8-4874-9346-ca3205c7c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:39.387984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c201467-deb8-4874-9346-ca3205c7c5d0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:39.391796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c87f0a-047f-4b1c-a686-b51233a9c9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:39.392064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87f0a-047f-4b1c-a686-b51233a9c9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:39.392343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87f0a-047f-4b1c-a686-b51233a9c9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:39.392616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87f0a-047f-4b1c-a686-b51233a9c9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:39.402031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c87f0a-047f-4b1c-a686-b51233a9c9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:39.403461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c87f0a-047f-4b1c-a686-b51233a9c9f8 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:39.415328 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 764/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:49.097143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=32 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:49.410109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=33 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:07.223618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e5d2-aacc-4671-9dea-ab1e73bf79e0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.224263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e5d2-aacc-4671-9dea-ab1e73bf79e0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.224263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e5d2-aacc-4671-9dea-ab1e73bf79e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.252405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6da9e5d2-aacc-4671-9dea-ab1e73bf79e0 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:07.254192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6da9e5d2-aacc-4671-9dea-ab1e73bf79e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:07.263768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 776/1540] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:07.275184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495baa-9668-42a4-8104-e4ff1e734fcb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.275787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495baa-9668-42a4-8104-e4ff1e734fcb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.275882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c495baa-9668-42a4-8104-e4ff1e734fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.305071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6c495baa-9668-42a4-8104-e4ff1e734fcb None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:07.306321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6c495baa-9668-42a4-8104-e4ff1e734fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:07.322710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 765/1541] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:07.327942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9e5d2-aacc-4671-9dea-ab1e73bf79e0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:07.338686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9e5d2-aacc-4671-9dea-ab1e73bf79e0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:07.351621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:07.352333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.352612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.352890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.353679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:07.353996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:07.355598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:07.377232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 777/1542] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:07.385984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c495baa-9668-42a4-8104-e4ff1e734fcb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:07.395539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c495baa-9668-42a4-8104-e4ff1e734fcb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:07.404424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7411f-edba-4326-a8e5-2fa1f6c23e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:07.405099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7411f-edba-4326-a8e5-2fa1f6c23e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.405379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7411f-edba-4326-a8e5-2fa1f6c23e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.405661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7411f-edba-4326-a8e5-2fa1f6c23e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.406354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7411f-edba-4326-a8e5-2fa1f6c23e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:07.408843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7411f-edba-4326-a8e5-2fa1f6c23e55 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:07.540512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 766/1543] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:07.544761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:07.559209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b60cb-99ca-4533-9f35-c0321fe5649c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.559730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b60cb-99ca-4533-9f35-c0321fe5649c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.560258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b60cb-99ca-4533-9f35-c0321fe5649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.566527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc028c-db04-4900-af19-0d8f2752495d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:07.607370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5f0b60cb-99ca-4533-9f35-c0321fe5649c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:07.608660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5f0b60cb-99ca-4533-9f35-c0321fe5649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:07.707243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc6531-5f20-448f-a53e-4070aa65857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:07.707950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc6531-5f20-448f-a53e-4070aa65857f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.708240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc6531-5f20-448f-a53e-4070aa65857f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.708516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc6531-5f20-448f-a53e-4070aa65857f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.709228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc6531-5f20-448f-a53e-4070aa65857f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:07.716852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc6531-5f20-448f-a53e-4070aa65857f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:07.755033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 767/1544] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:07.766494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380156e4-32a6-4955-87aa-29af414a5af1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.767438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380156e4-32a6-4955-87aa-29af414a5af1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.767655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380156e4-32a6-4955-87aa-29af414a5af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.801278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-380156e4-32a6-4955-87aa-29af414a5af1 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:07.802430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-380156e4-32a6-4955-87aa-29af414a5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:07.818159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 778/1545] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:07.819453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497665d0-919e-4835-a169-567145b85cb5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.819743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497665d0-919e-4835-a169-567145b85cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.820048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497665d0-919e-4835-a169-567145b85cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.825922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 768/1546] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:07.826770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380156e4-32a6-4955-87aa-29af414a5af1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:07.841709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380156e4-32a6-4955-87aa-29af414a5af1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:07.852852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-497665d0-919e-4835-a169-567145b85cb5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:07.854771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-497665d0-919e-4835-a169-567145b85cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:07.856722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792a23e-2b37-46c6-a0b2-c98e18bb832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:07.857777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792a23e-2b37-46c6-a0b2-c98e18bb832f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.860353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792a23e-2b37-46c6-a0b2-c98e18bb832f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.860353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792a23e-2b37-46c6-a0b2-c98e18bb832f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.860353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792a23e-2b37-46c6-a0b2-c98e18bb832f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:07.863103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792a23e-2b37-46c6-a0b2-c98e18bb832f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:07.881041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 779/1547] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:07.882436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497665d0-919e-4835-a169-567145b85cb5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:07.893138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 769/1548] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:07.894794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f916-95c8-41ff-822e-6fb7618d633e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.896882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f916-95c8-41ff-822e-6fb7618d633e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.898520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f916-95c8-41ff-822e-6fb7618d633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.904295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497665d0-919e-4835-a169-567145b85cb5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:07.914229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08889b-ae91-4095-9249-cad3e83167b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:07.915285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08889b-ae91-4095-9249-cad3e83167b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.915812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08889b-ae91-4095-9249-cad3e83167b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.916315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08889b-ae91-4095-9249-cad3e83167b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.917638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08889b-ae91-4095-9249-cad3e83167b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:07.918680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08889b-ae91-4095-9249-cad3e83167b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:07.920615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08889b-ae91-4095-9249-cad3e83167b1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:07.943962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3e72f916-95c8-41ff-822e-6fb7618d633e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:07.945626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e72f916-95c8-41ff-822e-6fb7618d633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:07.945941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 780/1549] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:07.951362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050fdf6-5273-4c75-b58d-8d3ec5bff32d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.951362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050fdf6-5273-4c75-b58d-8d3ec5bff32d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.951362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050fdf6-5273-4c75-b58d-8d3ec5bff32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.959069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 770/1550] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:07.960046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72f916-95c8-41ff-822e-6fb7618d633e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:07.968914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6050fdf6-5273-4c75-b58d-8d3ec5bff32d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:07.970679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6050fdf6-5273-4c75-b58d-8d3ec5bff32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:07.970823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72f916-95c8-41ff-822e-6fb7618d633e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:07.975614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf008e4-dd5c-4deb-b7a9-d29de4142f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:07.976301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf008e4-dd5c-4deb-b7a9-d29de4142f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.976581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf008e4-dd5c-4deb-b7a9-d29de4142f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.976853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf008e4-dd5c-4deb-b7a9-d29de4142f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.977566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf008e4-dd5c-4deb-b7a9-d29de4142f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:07.978731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 781/1551] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:07.979950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad37c3c-e184-4ded-97b5-082afd96402c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.980239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad37c3c-e184-4ded-97b5-082afd96402c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.980518 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad37c3c-e184-4ded-97b5-082afd96402c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.982610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf008e4-dd5c-4deb-b7a9-d29de4142f3d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:07.992846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 771/1552] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:07.994209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c9a2-8aa2-4430-8061-098bc6d65840 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.994505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c9a2-8aa2-4430-8061-098bc6d65840 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.994782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c9a2-8aa2-4430-8061-098bc6d65840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:07.998866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6ad37c3c-e184-4ded-97b5-082afd96402c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.000074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6ad37c3c-e184-4ded-97b5-082afd96402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.010209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 782/1553] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.011971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33acbdc-f5ec-4e8c-8236-3d6822149172 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.012456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33acbdc-f5ec-4e8c-8236-3d6822149172 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.012716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5d96c9a2-8aa2-4430-8061-098bc6d65840 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.012842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33acbdc-f5ec-4e8c-8236-3d6822149172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.013926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5d96c9a2-8aa2-4430-8061-098bc6d65840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.022541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 772/1554] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.023769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c7e5-59db-4469-85f4-925fabc76b20 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.024098 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c7e5-59db-4469-85f4-925fabc76b20 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.024400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c7e5-59db-4469-85f4-925fabc76b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.031297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b33acbdc-f5ec-4e8c-8236-3d6822149172 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.032579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b33acbdc-f5ec-4e8c-8236-3d6822149172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.040295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 783/1555] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.041040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33acbdc-f5ec-4e8c-8236-3d6822149172 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.042222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-42e7c7e5-59db-4469-85f4-925fabc76b20 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.043390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-42e7c7e5-59db-4469-85f4-925fabc76b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.050345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33acbdc-f5ec-4e8c-8236-3d6822149172 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.053810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 773/1556] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.054840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e3852-aca3-4590-942c-b4dce4f0577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.054988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947cbde-865f-44e8-b128-71249863a45c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.055247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947cbde-865f-44e8-b128-71249863a45c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.055479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3852-aca3-4590-942c-b4dce4f0577f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.055614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947cbde-865f-44e8-b128-71249863a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.055803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3852-aca3-4590-942c-b4dce4f0577f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.056113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3852-aca3-4590-942c-b4dce4f0577f admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.056804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e3852-aca3-4590-942c-b4dce4f0577f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.057813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-982e3852-aca3-4590-942c-b4dce4f0577f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:40:08.057813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jun 15 00:40:08.057813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: Jun 15 00:40:08.059021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e3852-aca3-4590-942c-b4dce4f0577f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.073645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e947cbde-865f-44e8-b128-71249863a45c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.074841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e947cbde-865f-44e8-b128-71249863a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.083329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 774/1557] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.094282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947cbde-865f-44e8-b128-71249863a45c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.094282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947cbde-865f-44e8-b128-71249863a45c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.098066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.099042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.099042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.099306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.099996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:08.100261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.101259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:40:08.101259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: warnings.warn(msg) Jun 15 00:40:08.101259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: Jun 15 00:40:08.102135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.114433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 775/1558] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:08.115172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.124327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae35fc-8de2-4368-9d60-e04a5ba692e9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.129006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60185b-50f1-41b6-8729-15786ac1b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.129877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60185b-50f1-41b6-8729-15786ac1b94b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.130144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60185b-50f1-41b6-8729-15786ac1b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.130424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60185b-50f1-41b6-8729-15786ac1b94b admin admin] PATH_INFO: `/v3/projects/1e1466c2e8504a34812a807bb0d1f077/users/a46c4b99af5d48a98148392d95e89f1a/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.145560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60185b-50f1-41b6-8729-15786ac1b94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1466c2e8504a34812a807bb0d1f077, user_id=a46c4b99af5d48a98148392d95e89f1a, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.148266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60185b-50f1-41b6-8729-15786ac1b94b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.178150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 784/1559] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:08.179573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53a93-a99c-48d3-8a5b-09b14e336a72 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.179862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53a93-a99c-48d3-8a5b-09b14e336a72 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.181579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53a93-a99c-48d3-8a5b-09b14e336a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.198027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3ba53a93-a99c-48d3-8a5b-09b14e336a72 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.199222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ba53a93-a99c-48d3-8a5b-09b14e336a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.255624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 785/1560] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.256924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ec43-6b8c-4c8e-b1bd-035264439d62 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.257255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ec43-6b8c-4c8e-b1bd-035264439d62 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.257516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ec43-6b8c-4c8e-b1bd-035264439d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.269008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 776/1561] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:08 2022] PUT /identity/v3/projects/1e1466c2e8504a34812a807bb0d1f077/users/a46c4b99af5d48a98148392d95e89f1a/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:08.270277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04b727-7ea0-4a81-b215-30370eadc26a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.270561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04b727-7ea0-4a81-b215-30370eadc26a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.270831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04b727-7ea0-4a81-b215-30370eadc26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.275686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-eb75ec43-6b8c-4c8e-b1bd-035264439d62 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.277037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-eb75ec43-6b8c-4c8e-b1bd-035264439d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.281781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:08.288333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bf04b727-7ea0-4a81-b215-30370eadc26a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.289544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bf04b727-7ea0-4a81-b215-30370eadc26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.322239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:08.337360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 786/1562] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.338639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201ea-6010-4064-b839-323326d074cf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.338929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201ea-6010-4064-b839-323326d074cf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.339209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201ea-6010-4064-b839-323326d074cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.350715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 777/1563] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.351535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04b727-7ea0-4a81-b215-30370eadc26a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.360629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fc0201ea-6010-4064-b839-323326d074cf None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.361458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04b727-7ea0-4a81-b215-30370eadc26a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.361880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fc0201ea-6010-4064-b839-323326d074cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.366117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.366779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.367055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.367334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.368091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:08.368402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.369879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 787/1564] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.370007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.370508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0201ea-6010-4064-b839-323326d074cf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.379472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0201ea-6010-4064-b839-323326d074cf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.383232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 778/1565] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:08.384202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.386224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c812b-93b4-4ddf-8660-a513e5f6b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.386224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c812b-93b4-4ddf-8660-a513e5f6b5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.386224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c812b-93b4-4ddf-8660-a513e5f6b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.386224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c812b-93b4-4ddf-8660-a513e5f6b5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.386900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c812b-93b4-4ddf-8660-a513e5f6b5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.388865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c812b-93b4-4ddf-8660-a513e5f6b5b9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.395051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb580890-6eee-40b7-a7d8-4c63565e4215 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.399644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352a504-a495-4863-b0c4-236ced79eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.400322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352a504-a495-4863-b0c4-236ced79eb96 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.400605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352a504-a495-4863-b0c4-236ced79eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.400882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352a504-a495-4863-b0c4-236ced79eb96 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.401592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352a504-a495-4863-b0c4-236ced79eb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.402585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-3352a504-a495-4863-b0c4-236ced79eb96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:40:08.402585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: warnings.warn(msg) Jun 15 00:40:08.402585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: Jun 15 00:40:08.403790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352a504-a495-4863-b0c4-236ced79eb96 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.534627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 788/1566] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:08.535449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c812b-93b4-4ddf-8660-a513e5f6b5b9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.593967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 779/1567] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:08.593967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef52c29-7160-475f-89d8-3caf5f4269a2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.593967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef52c29-7160-475f-89d8-3caf5f4269a2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.593967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef52c29-7160-475f-89d8-3caf5f4269a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.597520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c812b-93b4-4ddf-8660-a513e5f6b5b9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.602628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.603530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.603852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.604154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.604884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:08.605192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.606778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.618255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 789/1568] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:08.626735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7ef52c29-7160-475f-89d8-3caf5f4269a2 None None] MFA Rules not processed for user `a46c4b99af5d48a98148392d95e89f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:08.626875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.626961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7ef52c29-7160-475f-89d8-3caf5f4269a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.629536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ff06-bdf1-4758-8adc-66f458b1f065 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.634138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.635151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.635943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.636991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.637788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:08.638084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.639721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.652563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 790/1569] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:08.652952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.663108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bcb2a-b100-40f2-9af5-40ec47c3308d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.667676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.668353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.668635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.668909 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.669629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:08.669933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.671537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.682684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 791/1570] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:08.683530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.692769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca7d7-8a97-4c6d-b4bc-4be79d9083e2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.693520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 780/1571] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:08.694330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef52c29-7160-475f-89d8-3caf5f4269a2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.697922 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.698582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.698865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.699140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.699861 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:08.700192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.701773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.705352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef52c29-7160-475f-89d8-3caf5f4269a2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.709963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75248-ccb6-4422-8790-62e39e78b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.710615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75248-ccb6-4422-8790-62e39e78b730 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.710902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75248-ccb6-4422-8790-62e39e78b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.711182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe75248-ccb6-4422-8790-62e39e78b730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.711873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe75248-ccb6-4422-8790-62e39e78b730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.713849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe75248-ccb6-4422-8790-62e39e78b730 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.725507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 792/1572] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:08.725507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.740957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc492d-af00-42a6-a733-ee070e22849b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.745467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639ffd2-ce24-489b-ae8b-8f5d86b17045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.746128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ffd2-ce24-489b-ae8b-8f5d86b17045 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.746406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ffd2-ce24-489b-ae8b-8f5d86b17045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.746682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ffd2-ce24-489b-ae8b-8f5d86b17045 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.747368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639ffd2-ce24-489b-ae8b-8f5d86b17045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.749301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639ffd2-ce24-489b-ae8b-8f5d86b17045 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.822904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 781/1573] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:08.823856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75248-ccb6-4422-8790-62e39e78b730 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.852660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 793/1574] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:08.853403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639ffd2-ce24-489b-ae8b-8f5d86b17045 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.863116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639ffd2-ce24-489b-ae8b-8f5d86b17045 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.876888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:08.886191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe75248-ccb6-4422-8790-62e39e78b730 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.890789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f94d8-ee21-4a24-b265-cd2aa95f3402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.891553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f94d8-ee21-4a24-b265-cd2aa95f3402 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.892414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f94d8-ee21-4a24-b265-cd2aa95f3402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.892702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f94d8-ee21-4a24-b265-cd2aa95f3402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.893420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f94d8-ee21-4a24-b265-cd2aa95f3402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.895034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f94d8-ee21-4a24-b265-cd2aa95f3402 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.904704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 782/1575] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:08.905556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f94d8-ee21-4a24-b265-cd2aa95f3402 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:08.914923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f94d8-ee21-4a24-b265-cd2aa95f3402 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:08.919383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6a4c2-ec1a-43a7-97a8-dc2ff6b2cb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.919886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c5bc6-8adc-431d-b9e7-0ac7d4489469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:08.920028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6a4c2-ec1a-43a7-97a8-dc2ff6b2cb19 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.920310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6a4c2-ec1a-43a7-97a8-dc2ff6b2cb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.920583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6a4c2-ec1a-43a7-97a8-dc2ff6b2cb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.920696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c5bc6-8adc-431d-b9e7-0ac7d4489469 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:08.920863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c5bc6-8adc-431d-b9e7-0ac7d4489469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:08.921133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c5bc6-8adc-431d-b9e7-0ac7d4489469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.921256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6a4c2-ec1a-43a7-97a8-dc2ff6b2cb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.921813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c5bc6-8adc-431d-b9e7-0ac7d4489469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.923212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6a4c2-ec1a-43a7-97a8-dc2ff6b2cb19 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.924763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c5bc6-8adc-431d-b9e7-0ac7d4489469 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.933606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:09.023413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 783/1576] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.024234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6a4c2-ec1a-43a7-97a8-dc2ff6b2cb19 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.040297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 794/1577] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:08 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.041805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477fc37-7afd-4183-8a1d-34a551be6973 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.042091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477fc37-7afd-4183-8a1d-34a551be6973 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.042368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477fc37-7afd-4183-8a1d-34a551be6973 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.043601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 795/1578] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jun 15 00:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:09.044299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477fc37-7afd-4183-8a1d-34a551be6973 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.086981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6a4c2-ec1a-43a7-97a8-dc2ff6b2cb19 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.105853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477fc37-7afd-4183-8a1d-34a551be6973 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.110333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca916ebb-822d-4d62-bc11-2d1365c89df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.111484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca916ebb-822d-4d62-bc11-2d1365c89df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.111766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca916ebb-822d-4d62-bc11-2d1365c89df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.112077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca916ebb-822d-4d62-bc11-2d1365c89df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.112772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca916ebb-822d-4d62-bc11-2d1365c89df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.115019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca916ebb-822d-4d62-bc11-2d1365c89df4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.143357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133bdd2-8f7f-4912-a57e-ccb42ad5f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.144285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133bdd2-8f7f-4912-a57e-ccb42ad5f17e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.144285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133bdd2-8f7f-4912-a57e-ccb42ad5f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.144567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133bdd2-8f7f-4912-a57e-ccb42ad5f17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.145241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133bdd2-8f7f-4912-a57e-ccb42ad5f17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.147114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133bdd2-8f7f-4912-a57e-ccb42ad5f17e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.234481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 796/1579] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:09 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.235952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca916ebb-822d-4d62-bc11-2d1365c89df4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.278629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 784/1580] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:09 2022] POST /identity/v3/projects => generated 355 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.278629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133bdd2-8f7f-4912-a57e-ccb42ad5f17e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.300722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca916ebb-822d-4d62-bc11-2d1365c89df4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.333761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:09.337233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133bdd2-8f7f-4912-a57e-ccb42ad5f17e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.345012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554d5ff-1131-41a5-9c68-70eefaaa486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.345012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554d5ff-1131-41a5-9c68-70eefaaa486b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.345012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554d5ff-1131-41a5-9c68-70eefaaa486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.345012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554d5ff-1131-41a5-9c68-70eefaaa486b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.345363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554d5ff-1131-41a5-9c68-70eefaaa486b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.345363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554d5ff-1131-41a5-9c68-70eefaaa486b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.355123 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 785/1581] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:09.356153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554d5ff-1131-41a5-9c68-70eefaaa486b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.358735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679956-a9c6-43ac-9180-1fcf02140581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.359409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679956-a9c6-43ac-9180-1fcf02140581 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.359687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679956-a9c6-43ac-9180-1fcf02140581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.359986 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679956-a9c6-43ac-9180-1fcf02140581 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.361206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56679956-a9c6-43ac-9180-1fcf02140581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.363143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56679956-a9c6-43ac-9180-1fcf02140581 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.367816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554d5ff-1131-41a5-9c68-70eefaaa486b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.372375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae505c8e-c09c-42d5-8789-eaa9fb85ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.373814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505c8e-c09c-42d5-8789-eaa9fb85ae17 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.373814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505c8e-c09c-42d5-8789-eaa9fb85ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.373814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505c8e-c09c-42d5-8789-eaa9fb85ae17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.374213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505c8e-c09c-42d5-8789-eaa9fb85ae17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.375764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505c8e-c09c-42d5-8789-eaa9fb85ae17 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.387238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 786/1582] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:09.388175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae505c8e-c09c-42d5-8789-eaa9fb85ae17 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.397642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae505c8e-c09c-42d5-8789-eaa9fb85ae17 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.402101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942827f9-ed19-419a-9dc1-31bcbc0e7e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.408321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942827f9-ed19-419a-9dc1-31bcbc0e7e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.408321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942827f9-ed19-419a-9dc1-31bcbc0e7e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.408321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942827f9-ed19-419a-9dc1-31bcbc0e7e29 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.408321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942827f9-ed19-419a-9dc1-31bcbc0e7e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.408321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942827f9-ed19-419a-9dc1-31bcbc0e7e29 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.413178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:09.479401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 797/1583] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:09 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.479401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679956-a9c6-43ac-9180-1fcf02140581 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.487361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679956-a9c6-43ac-9180-1fcf02140581 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.491941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d1cc-6f7a-488f-9d90-0ec5792774f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.492586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d1cc-6f7a-488f-9d90-0ec5792774f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.492971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d1cc-6f7a-488f-9d90-0ec5792774f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.493252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d1cc-6f7a-488f-9d90-0ec5792774f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.493922 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d1cc-6f7a-488f-9d90-0ec5792774f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.495852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d1cc-6f7a-488f-9d90-0ec5792774f6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.532155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 787/1584] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:09 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.533919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b56bd9-74c3-43d6-956e-80836657c695 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.534211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b56bd9-74c3-43d6-956e-80836657c695 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.534599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b56bd9-74c3-43d6-956e-80836657c695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.552306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b5b56bd9-74c3-43d6-956e-80836657c695 None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:09.553499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b5b56bd9-74c3-43d6-956e-80836657c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:09.611600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 798/1585] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:09 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.612529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d1cc-6f7a-488f-9d90-0ec5792774f6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.619164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 788/1586] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jun 15 00:40:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:09.620980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b56bd9-74c3-43d6-956e-80836657c695 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.623114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d1cc-6f7a-488f-9d90-0ec5792774f6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.628296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8b658-32f4-4132-b6e0-2de947ea5509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.628974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b658-32f4-4132-b6e0-2de947ea5509 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.629253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b658-32f4-4132-b6e0-2de947ea5509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.629521 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b658-32f4-4132-b6e0-2de947ea5509 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.630195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8b658-32f4-4132-b6e0-2de947ea5509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.630936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b56bd9-74c3-43d6-956e-80836657c695 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.632103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8b658-32f4-4132-b6e0-2de947ea5509 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.635448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cb199-21db-40a7-9712-fa2c9fcd94c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.636392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cb199-21db-40a7-9712-fa2c9fcd94c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.636678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cb199-21db-40a7-9712-fa2c9fcd94c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.636957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cb199-21db-40a7-9712-fa2c9fcd94c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.637641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cb199-21db-40a7-9712-fa2c9fcd94c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.639547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cb199-21db-40a7-9712-fa2c9fcd94c8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.731250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 799/1587] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:09 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.732553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8b658-32f4-4132-b6e0-2de947ea5509 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.743832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8b658-32f4-4132-b6e0-2de947ea5509 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.748337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f7701-d51f-4fa0-91dc-22ee3a203a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.748983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f7701-d51f-4fa0-91dc-22ee3a203a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.749264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f7701-d51f-4fa0-91dc-22ee3a203a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.749537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f7701-d51f-4fa0-91dc-22ee3a203a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.750359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f7701-d51f-4fa0-91dc-22ee3a203a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.751949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f7701-d51f-4fa0-91dc-22ee3a203a1f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.760913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 789/1588] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:09 2022] POST /identity/v3/users => generated 278 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:09.760913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cb199-21db-40a7-9712-fa2c9fcd94c8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.761954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 800/1589] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:09.769839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f7701-d51f-4fa0-91dc-22ee3a203a1f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.770095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cb199-21db-40a7-9712-fa2c9fcd94c8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.774727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6cae0-3267-4812-9e65-be485793d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.775057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f7701-d51f-4fa0-91dc-22ee3a203a1f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.775592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6cae0-3267-4812-9e65-be485793d47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.775873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6cae0-3267-4812-9e65-be485793d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.776180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6cae0-3267-4812-9e65-be485793d47e admin admin] PATH_INFO: `/v3/projects/c8657f2c5b7048b79727c0fb22aaf8dc/users/4b4503f682944545a21e152a4361ac76/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.780826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21f11-8404-416e-9438-66b8278bb549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.781467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21f11-8404-416e-9438-66b8278bb549 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.781750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21f11-8404-416e-9438-66b8278bb549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.782023 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21f11-8404-416e-9438-66b8278bb549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.783237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21f11-8404-416e-9438-66b8278bb549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.784843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d21f11-8404-416e-9438-66b8278bb549 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.791787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6cae0-3267-4812-9e65-be485793d47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8657f2c5b7048b79727c0fb22aaf8dc, user_id=4b4503f682944545a21e152a4361ac76, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.794561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6cae0-3267-4812-9e65-be485793d47e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.795319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 801/1590] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:09.796144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21f11-8404-416e-9438-66b8278bb549 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.805951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21f11-8404-416e-9438-66b8278bb549 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.810388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19f25e-c084-40ba-9cb3-d6da6c73472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.811006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19f25e-c084-40ba-9cb3-d6da6c73472c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.811288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19f25e-c084-40ba-9cb3-d6da6c73472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.811561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19f25e-c084-40ba-9cb3-d6da6c73472c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.812305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19f25e-c084-40ba-9cb3-d6da6c73472c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.813852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19f25e-c084-40ba-9cb3-d6da6c73472c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.823251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 802/1591] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:09.824026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19f25e-c084-40ba-9cb3-d6da6c73472c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.833410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19f25e-c084-40ba-9cb3-d6da6c73472c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.837812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155373b4-75a1-4cc3-8fd1-76ccf5e2965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.838412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155373b4-75a1-4cc3-8fd1-76ccf5e2965d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.838694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155373b4-75a1-4cc3-8fd1-76ccf5e2965d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.838969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155373b4-75a1-4cc3-8fd1-76ccf5e2965d admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.839658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155373b4-75a1-4cc3-8fd1-76ccf5e2965d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.841208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155373b4-75a1-4cc3-8fd1-76ccf5e2965d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.851534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 803/1592] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:09.852305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155373b4-75a1-4cc3-8fd1-76ccf5e2965d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.863489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155373b4-75a1-4cc3-8fd1-76ccf5e2965d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.868813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174a18e-816f-416a-bc51-8bd339ba4158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.872024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174a18e-816f-416a-bc51-8bd339ba4158 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.872024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174a18e-816f-416a-bc51-8bd339ba4158 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.872024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174a18e-816f-416a-bc51-8bd339ba4158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.873418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 790/1593] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:09 2022] PUT /identity/v3/projects/c8657f2c5b7048b79727c0fb22aaf8dc/users/4b4503f682944545a21e152a4361ac76/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:09.883458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6cae0-3267-4812-9e65-be485793d47e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.926320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174a18e-816f-416a-bc51-8bd339ba4158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.927935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174a18e-816f-416a-bc51-8bd339ba4158 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.936985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 804/1594] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:09.937738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174a18e-816f-416a-bc51-8bd339ba4158 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.944724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6cae0-3267-4812-9e65-be485793d47e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.947564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174a18e-816f-416a-bc51-8bd339ba4158 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.949312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d231a99-860d-4cdd-84ed-5b30f37a5598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.949971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d231a99-860d-4cdd-84ed-5b30f37a5598 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.950251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d231a99-860d-4cdd-84ed-5b30f37a5598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.950537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d231a99-860d-4cdd-84ed-5b30f37a5598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.951346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d231a99-860d-4cdd-84ed-5b30f37a5598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.952244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.953053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d231a99-860d-4cdd-84ed-5b30f37a5598 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.953176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.953392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.953667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] PATH_INFO: `/v3/projects/7c72ff79bb364f0d9bc9d9397abd5318/users/4acef8b517cc41e684dfa9b3a765edb8/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.964222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 791/1595] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:09.964963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d231a99-860d-4cdd-84ed-5b30f37a5598 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:09.972597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c72ff79bb364f0d9bc9d9397abd5318, user_id=4acef8b517cc41e684dfa9b3a765edb8, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.973630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:40:09.973630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jun 15 00:40:09.973630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: Jun 15 00:40:09.975298 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d231a99-860d-4cdd-84ed-5b30f37a5598 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:09.975564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.980013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf21e92-a7db-4d89-be92-49dcec6e66bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:09.980644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf21e92-a7db-4d89-be92-49dcec6e66bd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:09.980925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf21e92-a7db-4d89-be92-49dcec6e66bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:09.981194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf21e92-a7db-4d89-be92-49dcec6e66bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:09.981921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf21e92-a7db-4d89-be92-49dcec6e66bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:09.983498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf21e92-a7db-4d89-be92-49dcec6e66bd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:09.993680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 792/1596] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:09.994437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf21e92-a7db-4d89-be92-49dcec6e66bd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.003761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf21e92-a7db-4d89-be92-49dcec6e66bd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.008258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494c23-89c5-4dd8-9bbb-ed144e87def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.008933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494c23-89c5-4dd8-9bbb-ed144e87def2 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.009160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494c23-89c5-4dd8-9bbb-ed144e87def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.009428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494c23-89c5-4dd8-9bbb-ed144e87def2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.010135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f494c23-89c5-4dd8-9bbb-ed144e87def2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.011885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f494c23-89c5-4dd8-9bbb-ed144e87def2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.022626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 793/1597] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:10.026843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494c23-89c5-4dd8-9bbb-ed144e87def2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.032989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494c23-89c5-4dd8-9bbb-ed144e87def2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.037650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80f451-6611-46e6-86f8-ade5f3ba5137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.038371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f451-6611-46e6-86f8-ade5f3ba5137 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.038674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f451-6611-46e6-86f8-ade5f3ba5137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.038982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80f451-6611-46e6-86f8-ade5f3ba5137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.039702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80f451-6611-46e6-86f8-ade5f3ba5137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.041279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80f451-6611-46e6-86f8-ade5f3ba5137 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.050665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 805/1598] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:09 2022] PUT /identity/v3/projects/7c72ff79bb364f0d9bc9d9397abd5318/users/4acef8b517cc41e684dfa9b3a765edb8/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:10.052648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.056502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 794/1599] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:10.056502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509b5d9-ad86-4a43-bed2-0ac57d473fdb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.056502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509b5d9-ad86-4a43-bed2-0ac57d473fdb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.056502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509b5d9-ad86-4a43-bed2-0ac57d473fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.062293 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.079733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.082131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d509b5d9-ad86-4a43-bed2-0ac57d473fdb None None] MFA Rules not processed for user `4b4503f682944545a21e152a4361ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:10.083349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d509b5d9-ad86-4a43-bed2-0ac57d473fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:10.123310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504f053-123d-4de5-8756-bccf6436a2aa admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.128265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff899554-8bbd-47c8-90d8-f480bcfd6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.129107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff899554-8bbd-47c8-90d8-f480bcfd6f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.129400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff899554-8bbd-47c8-90d8-f480bcfd6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.129682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff899554-8bbd-47c8-90d8-f480bcfd6f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.130400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff899554-8bbd-47c8-90d8-f480bcfd6f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.132028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff899554-8bbd-47c8-90d8-f480bcfd6f46 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.146533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 806/1600] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:10.148501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff899554-8bbd-47c8-90d8-f480bcfd6f46 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.151778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 795/1601] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:10.152692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509b5d9-ad86-4a43-bed2-0ac57d473fdb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.158607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff899554-8bbd-47c8-90d8-f480bcfd6f46 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.167681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbabe8-31cf-402d-b23f-0e602a51b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.168381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbabe8-31cf-402d-b23f-0e602a51b33c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.168665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbabe8-31cf-402d-b23f-0e602a51b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.168942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbabe8-31cf-402d-b23f-0e602a51b33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.169058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509b5d9-ad86-4a43-bed2-0ac57d473fdb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.169668 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbabe8-31cf-402d-b23f-0e602a51b33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.171257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbabe8-31cf-402d-b23f-0e602a51b33c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.174237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef169e-8ae6-4fa3-b5b5-f877daa14aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.175216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef169e-8ae6-4fa3-b5b5-f877daa14aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.175898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef169e-8ae6-4fa3-b5b5-f877daa14aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.176548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef169e-8ae6-4fa3-b5b5-f877daa14aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.178003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef169e-8ae6-4fa3-b5b5-f877daa14aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.179589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef169e-8ae6-4fa3-b5b5-f877daa14aaa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.182519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 807/1602] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:10.184763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbabe8-31cf-402d-b23f-0e602a51b33c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.190660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 796/1603] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:10.191892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dcac1-c411-4c40-9986-44d148a968b8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.192243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dcac1-c411-4c40-9986-44d148a968b8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.192527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dcac1-c411-4c40-9986-44d148a968b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.196788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbabe8-31cf-402d-b23f-0e602a51b33c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.205908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ae7a5-9062-4a9e-bedd-1aea5f1a1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.206784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ae7a5-9062-4a9e-bedd-1aea5f1a1001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.207064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ae7a5-9062-4a9e-bedd-1aea5f1a1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.207339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ae7a5-9062-4a9e-bedd-1aea5f1a1001 admin admin] PATH_INFO: `/v3/projects/5075d84d5c6f4ad89f397c8b563e17df/users/2ff9f53decbc44ce9166f6c841e8ea02/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.210171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fb4dcac1-c411-4c40-9986-44d148a968b8 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:10.211367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb4dcac1-c411-4c40-9986-44d148a968b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:10.219034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 797/1604] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:10.219597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dcac1-c411-4c40-9986-44d148a968b8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.227854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ae7a5-9062-4a9e-bedd-1aea5f1a1001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5075d84d5c6f4ad89f397c8b563e17df, user_id=2ff9f53decbc44ce9166f6c841e8ea02, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.229664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dcac1-c411-4c40-9986-44d148a968b8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.230820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ae7a5-9062-4a9e-bedd-1aea5f1a1001 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.234709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbbb21-e8df-4c22-b781-e9357fbbbf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.236167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbbb21-e8df-4c22-b781-e9357fbbbf2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.236447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbbb21-e8df-4c22-b781-e9357fbbbf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.236719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbbb21-e8df-4c22-b781-e9357fbbbf2d admin admin] PATH_INFO: `/v3/projects/d5d0b6a397e844c0b4260544cd69dfee/users/927eff6c108d424db27862b86671c15a/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.250887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbbb21-e8df-4c22-b781-e9357fbbbf2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d0b6a397e844c0b4260544cd69dfee, user_id=927eff6c108d424db27862b86671c15a, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.253555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbbb21-e8df-4c22-b781-e9357fbbbf2d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.298881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 808/1605] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:10 2022] PUT /identity/v3/projects/5075d84d5c6f4ad89f397c8b563e17df/users/2ff9f53decbc44ce9166f6c841e8ea02/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:10.303404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ae7a5-9062-4a9e-bedd-1aea5f1a1001 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.322674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 798/1606] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:10 2022] PUT /identity/v3/projects/d5d0b6a397e844c0b4260544cd69dfee/users/927eff6c108d424db27862b86671c15a/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:10.327133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbbb21-e8df-4c22-b781-e9357fbbbf2d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.377838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ae7a5-9062-4a9e-bedd-1aea5f1a1001 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.391942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbbb21-e8df-4c22-b781-e9357fbbbf2d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.399791 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4492d-1fbf-46ef-b4c9-afbbab9737b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.400513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4492d-1fbf-46ef-b4c9-afbbab9737b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.400788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4492d-1fbf-46ef-b4c9-afbbab9737b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.401064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4492d-1fbf-46ef-b4c9-afbbab9737b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.401760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4492d-1fbf-46ef-b4c9-afbbab9737b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.403691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4492d-1fbf-46ef-b4c9-afbbab9737b8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.452246 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f8d19-8bd1-4f3d-8b04-89037c9182c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.453338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8d19-8bd1-4f3d-8b04-89037c9182c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.453689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8d19-8bd1-4f3d-8b04-89037c9182c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.454030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f8d19-8bd1-4f3d-8b04-89037c9182c4 admin admin] PATH_INFO: `/v3/projects/bcdef82f627f42b29f6da17f6bad6dd4/users/4989693e66c44d6a8e5f8543f1b9c516/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.469372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f8d19-8bd1-4f3d-8b04-89037c9182c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdef82f627f42b29f6da17f6bad6dd4, user_id=4989693e66c44d6a8e5f8543f1b9c516, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.472629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f8d19-8bd1-4f3d-8b04-89037c9182c4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.529434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 799/1607] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:10 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:10.529434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4492d-1fbf-46ef-b4c9-afbbab9737b8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.555504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 809/1608] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:10 2022] PUT /identity/v3/projects/bcdef82f627f42b29f6da17f6bad6dd4/users/4989693e66c44d6a8e5f8543f1b9c516/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:10.556835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f8d19-8bd1-4f3d-8b04-89037c9182c4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.568416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.575648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.596314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4492d-1fbf-46ef-b4c9-afbbab9737b8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.616996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f8d19-8bd1-4f3d-8b04-89037c9182c4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.621695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d1946-136e-4372-813b-fb985faffa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.622573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d1946-136e-4372-813b-fb985faffa25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.622854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d1946-136e-4372-813b-fb985faffa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.623128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d1946-136e-4372-813b-fb985faffa25 admin admin] PATH_INFO: `/v3/projects/2c01519e87f2421aaf886211e2daad71/users/c8d97c1e2c004cb68ac0121b710c0e66/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.639121 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d1946-136e-4372-813b-fb985faffa25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c01519e87f2421aaf886211e2daad71, user_id=c8d97c1e2c004cb68ac0121b710c0e66, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.642567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d1946-136e-4372-813b-fb985faffa25 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.650714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b941b3-faba-4efa-aafd-bded2ac72b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.654325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b941b3-faba-4efa-aafd-bded2ac72b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.654325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b941b3-faba-4efa-aafd-bded2ac72b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.654325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b941b3-faba-4efa-aafd-bded2ac72b54 admin admin] PATH_INFO: `/v3/projects/30f2ff4320764a69bb987d567aed9201/users/d9a0bbb1f50c42acb50dac254a653da4/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.666803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b941b3-faba-4efa-aafd-bded2ac72b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f2ff4320764a69bb987d567aed9201, user_id=d9a0bbb1f50c42acb50dac254a653da4, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.669478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b941b3-faba-4efa-aafd-bded2ac72b54 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.759083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 810/1609] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:10 2022] PUT /identity/v3/projects/2c01519e87f2421aaf886211e2daad71/users/c8d97c1e2c004cb68ac0121b710c0e66/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:10.759441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 800/1610] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:10 2022] PUT /identity/v3/projects/30f2ff4320764a69bb987d567aed9201/users/d9a0bbb1f50c42acb50dac254a653da4/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:10.760085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d1946-136e-4372-813b-fb985faffa25 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.761005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30ea0f-adb5-4701-8857-4dafadfb9c3a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.761294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30ea0f-adb5-4701-8857-4dafadfb9c3a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.761568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30ea0f-adb5-4701-8857-4dafadfb9c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.783892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6a30ea0f-adb5-4701-8857-4dafadfb9c3a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:10.785152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6a30ea0f-adb5-4701-8857-4dafadfb9c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:10.821211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d1946-136e-4372-813b-fb985faffa25 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.841704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 801/1611] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:10.842978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304a2c-be95-45d1-8621-4ce432fbbf91 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.843269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304a2c-be95-45d1-8621-4ce432fbbf91 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.843550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304a2c-be95-45d1-8621-4ce432fbbf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.869741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ee159-0291-4a51-a7b6-8ceec9a1b46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.869962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a9304a2c-be95-45d1-8621-4ce432fbbf91 None None] MFA Rules not processed for user `927eff6c108d424db27862b86671c15a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:10.870389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ee159-0291-4a51-a7b6-8ceec9a1b46d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.870672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ee159-0291-4a51-a7b6-8ceec9a1b46d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.870948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ee159-0291-4a51-a7b6-8ceec9a1b46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.871043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a9304a2c-be95-45d1-8621-4ce432fbbf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:10.879941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ee159-0291-4a51-a7b6-8ceec9a1b46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.882794 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ee159-0291-4a51-a7b6-8ceec9a1b46d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.893255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 811/1612] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:10.894745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab196a0f-5718-4bd1-9c76-8202c26f59cf None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.894976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab196a0f-5718-4bd1-9c76-8202c26f59cf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.895197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab196a0f-5718-4bd1-9c76-8202c26f59cf None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.896861 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 812/1613] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jun 15 00:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:10.898079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab196a0f-5718-4bd1-9c76-8202c26f59cf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:10.912267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab196a0f-5718-4bd1-9c76-8202c26f59cf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:10.917214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febd3c-3024-49f1-8eb8-e93df0b02921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:10.917889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febd3c-3024-49f1-8eb8-e93df0b02921 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.918143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febd3c-3024-49f1-8eb8-e93df0b02921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.918413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febd3c-3024-49f1-8eb8-e93df0b02921 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.919098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febd3c-3024-49f1-8eb8-e93df0b02921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:10.921206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febd3c-3024-49f1-8eb8-e93df0b02921 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:10.934196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:10.939354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 802/1614] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:10.943829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028235a-642a-4adf-a55c-21284ddb1e2a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.943829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028235a-642a-4adf-a55c-21284ddb1e2a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.943829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028235a-642a-4adf-a55c-21284ddb1e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.958414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6028235a-642a-4adf-a55c-21284ddb1e2a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:10.959583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6028235a-642a-4adf-a55c-21284ddb1e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:10.967266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 803/1615] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:10.968560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1a5c3-34b6-4df7-9675-fffe40afb3cd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:10.968859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1a5c3-34b6-4df7-9675-fffe40afb3cd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:10.969166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1a5c3-34b6-4df7-9675-fffe40afb3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:10.994881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-19c1a5c3-34b6-4df7-9675-fffe40afb3cd None None] MFA Rules not processed for user `c8d97c1e2c004cb68ac0121b710c0e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:10.996102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-19c1a5c3-34b6-4df7-9675-fffe40afb3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:11.030771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 813/1616] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:10 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:11.030771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb13790-9575-4615-9313-c07740e41e53 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.030771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb13790-9575-4615-9313-c07740e41e53 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.030771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb13790-9575-4615-9313-c07740e41e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.048453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-adb13790-9575-4615-9313-c07740e41e53 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:11.049813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-adb13790-9575-4615-9313-c07740e41e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:11.057882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 814/1617] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:11.058542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb13790-9575-4615-9313-c07740e41e53 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.068901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb13790-9575-4615-9313-c07740e41e53 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.073045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 804/1618] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:11.073204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1176ff-23ea-4701-8ea7-bdb4feec5a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.073716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1176ff-23ea-4701-8ea7-bdb4feec5a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.073993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1176ff-23ea-4701-8ea7-bdb4feec5a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.074262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1176ff-23ea-4701-8ea7-bdb4feec5a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.075261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166120a-31bc-40b0-a5ac-d262e5924642 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.075738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166120a-31bc-40b0-a5ac-d262e5924642 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.076525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166120a-31bc-40b0-a5ac-d262e5924642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.087143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1176ff-23ea-4701-8ea7-bdb4feec5a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.088814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1176ff-23ea-4701-8ea7-bdb4feec5a64 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.097211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3166120a-31bc-40b0-a5ac-d262e5924642 None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:11.098762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3166120a-31bc-40b0-a5ac-d262e5924642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:11.099416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 815/1619] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:11.100088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1176ff-23ea-4701-8ea7-bdb4feec5a64 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.120229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:11.172445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 805/1620] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jun 15 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:11.174079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166120a-31bc-40b0-a5ac-d262e5924642 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.174581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1176ff-23ea-4701-8ea7-bdb4feec5a64 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.180941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7782ac3-2219-4297-8830-f4dbb73d72e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.181477 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7782ac3-2219-4297-8830-f4dbb73d72e9 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.181764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7782ac3-2219-4297-8830-f4dbb73d72e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.182047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7782ac3-2219-4297-8830-f4dbb73d72e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.185195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166120a-31bc-40b0-a5ac-d262e5924642 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.189710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.190365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.190639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.190921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.191876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7782ac3-2219-4297-8830-f4dbb73d72e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.193524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7782ac3-2219-4297-8830-f4dbb73d72e9 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.201186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.202617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.203583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 816/1621] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:11.204970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7782ac3-2219-4297-8830-f4dbb73d72e9 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.214262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 806/1622] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:11.215109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.215242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7782ac3-2219-4297-8830-f4dbb73d72e9 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.216455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:11.220690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7585-7097-47a1-a02a-87c330adc288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.221358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7585-7097-47a1-a02a-87c330adc288 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.221645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7585-7097-47a1-a02a-87c330adc288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.221924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7585-7097-47a1-a02a-87c330adc288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.222656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc7585-7097-47a1-a02a-87c330adc288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.224852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc7585-7097-47a1-a02a-87c330adc288 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.228243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0d139-6142-4f26-87ac-837986da5184 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.232886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efaecb-5846-4cd2-978b-c4ced7d0c13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.233717 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efaecb-5846-4cd2-978b-c4ced7d0c13a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.234647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efaecb-5846-4cd2-978b-c4ced7d0c13a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.235103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efaecb-5846-4cd2-978b-c4ced7d0c13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.236746 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 817/1623] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:11.237581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7585-7097-47a1-a02a-87c330adc288 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.247344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efaecb-5846-4cd2-978b-c4ced7d0c13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.248606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7585-7097-47a1-a02a-87c330adc288 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.249017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efaecb-5846-4cd2-978b-c4ced7d0c13a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.254367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917160a-b9cc-48a5-8c15-b6906e7b062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.255043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917160a-b9cc-48a5-8c15-b6906e7b062d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.255346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917160a-b9cc-48a5-8c15-b6906e7b062d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.255712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917160a-b9cc-48a5-8c15-b6906e7b062d admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.256391 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917160a-b9cc-48a5-8c15-b6906e7b062d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.258388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917160a-b9cc-48a5-8c15-b6906e7b062d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.272682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 807/1624] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:11.274835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0fb33-96bf-43a8-aa15-6e877a9b1650 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.275132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0fb33-96bf-43a8-aa15-6e877a9b1650 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.275418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0fb33-96bf-43a8-aa15-6e877a9b1650 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.281718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 808/1625] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jun 15 00:40:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:11.286307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0fb33-96bf-43a8-aa15-6e877a9b1650 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.296166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0fb33-96bf-43a8-aa15-6e877a9b1650 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.300913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a0550-05ec-4b1c-9498-895fa90bfd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.302036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a0550-05ec-4b1c-9498-895fa90bfd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.302323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a0550-05ec-4b1c-9498-895fa90bfd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.302625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a0550-05ec-4b1c-9498-895fa90bfd18 admin admin] PATH_INFO: `/v3/projects/acf431f3c1e846cebc0d460f7f1cd0b5/users/c1b79db34dea454abc59175a4e2cd8a6/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.319925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a0550-05ec-4b1c-9498-895fa90bfd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf431f3c1e846cebc0d460f7f1cd0b5, user_id=c1b79db34dea454abc59175a4e2cd8a6, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.322634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a0550-05ec-4b1c-9498-895fa90bfd18 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.383738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 818/1626] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:11 2022] POST /identity/v3/projects => generated 355 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:11.383738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb3e1f-35f2-4a6f-a67b-9663b16db6bf None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.383738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb3e1f-35f2-4a6f-a67b-9663b16db6bf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.383738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb3e1f-35f2-4a6f-a67b-9663b16db6bf None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.384786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 819/1627] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jun 15 00:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:11.389173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e42b-88c6-4979-8e98-a6caed49fe17 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.389457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e42b-88c6-4979-8e98-a6caed49fe17 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.389735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e42b-88c6-4979-8e98-a6caed49fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.407200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c072e42b-88c6-4979-8e98-a6caed49fe17 None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:11.409903 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c072e42b-88c6-4979-8e98-a6caed49fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:11.434593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 809/1628] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:11 2022] PUT /identity/v3/projects/acf431f3c1e846cebc0d460f7f1cd0b5/users/c1b79db34dea454abc59175a4e2cd8a6/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:11.435499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a0550-05ec-4b1c-9498-895fa90bfd18 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.462763 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:11.484497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 820/1629] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:11.486307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcb6fb-8cb2-4287-8358-4cf44ae14eb7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.486504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcb6fb-8cb2-4287-8358-4cf44ae14eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.486799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcb6fb-8cb2-4287-8358-4cf44ae14eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.507856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-45bcb6fb-8cb2-4287-8358-4cf44ae14eb7 None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:11.509177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-45bcb6fb-8cb2-4287-8358-4cf44ae14eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:11.538550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a0550-05ec-4b1c-9498-895fa90bfd18 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.545388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401d46-7290-4c21-8344-05b3897dd2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.546784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401d46-7290-4c21-8344-05b3897dd2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.547072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401d46-7290-4c21-8344-05b3897dd2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.547533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401d46-7290-4c21-8344-05b3897dd2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.548895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401d46-7290-4c21-8344-05b3897dd2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.551361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401d46-7290-4c21-8344-05b3897dd2b6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.575469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:11.591705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 821/1630] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:11.597005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcb6fb-8cb2-4287-8358-4cf44ae14eb7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.608851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcb6fb-8cb2-4287-8358-4cf44ae14eb7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.614243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca57c8-1eef-411f-ac51-3a0c0e0ad5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.616562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca57c8-1eef-411f-ac51-3a0c0e0ad5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.616562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca57c8-1eef-411f-ac51-3a0c0e0ad5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.616562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca57c8-1eef-411f-ac51-3a0c0e0ad5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.616562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca57c8-1eef-411f-ac51-3a0c0e0ad5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.617953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca57c8-1eef-411f-ac51-3a0c0e0ad5f5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.642856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 810/1631] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:11 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:11.644537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 822/1632] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:11.645184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401d46-7290-4c21-8344-05b3897dd2b6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.645305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca57c8-1eef-411f-ac51-3a0c0e0ad5f5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.764961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca57c8-1eef-411f-ac51-3a0c0e0ad5f5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.765354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401d46-7290-4c21-8344-05b3897dd2b6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.776113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4635ec-8d43-4b82-a33c-af7ef9d82249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.776523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b70aad-86d2-43c0-bbad-63231d6d4398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.777423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b70aad-86d2-43c0-bbad-63231d6d4398 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.777717 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b70aad-86d2-43c0-bbad-63231d6d4398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.778118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b70aad-86d2-43c0-bbad-63231d6d4398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.779516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4635ec-8d43-4b82-a33c-af7ef9d82249 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.780359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4635ec-8d43-4b82-a33c-af7ef9d82249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.780857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4635ec-8d43-4b82-a33c-af7ef9d82249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.796138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b70aad-86d2-43c0-bbad-63231d6d4398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.798723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b70aad-86d2-43c0-bbad-63231d6d4398 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.800140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4635ec-8d43-4b82-a33c-af7ef9d82249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.803199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4635ec-8d43-4b82-a33c-af7ef9d82249 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.817095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 811/1633] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:11.818420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b70aad-86d2-43c0-bbad-63231d6d4398 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.833459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b70aad-86d2-43c0-bbad-63231d6d4398 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.835256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 823/1634] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:11.839183 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4635ec-8d43-4b82-a33c-af7ef9d82249 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.841403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701dac9-dcf0-4543-93e3-8ca3a3bd8f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.842812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701dac9-dcf0-4543-93e3-8ca3a3bd8f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.843174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701dac9-dcf0-4543-93e3-8ca3a3bd8f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.843450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701dac9-dcf0-4543-93e3-8ca3a3bd8f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.844317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701dac9-dcf0-4543-93e3-8ca3a3bd8f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.848449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701dac9-dcf0-4543-93e3-8ca3a3bd8f62 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.870299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 812/1635] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:11.870299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701dac9-dcf0-4543-93e3-8ca3a3bd8f62 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:11.878105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4635ec-8d43-4b82-a33c-af7ef9d82249 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.882839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701dac9-dcf0-4543-93e3-8ca3a3bd8f62 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:11.889784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a0f6-b100-461f-850c-743bd575eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.891222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a8be7-9ba4-49da-9944-b1dfc71901da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:11.891360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a0f6-b100-461f-850c-743bd575eb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.891582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a0f6-b100-461f-850c-743bd575eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.891861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a0f6-b100-461f-850c-743bd575eb95 admin admin] PATH_INFO: `/v3/projects/75aee4f8b1e54d3da43effff671c5c10/users/e27664b08c2d43388dc8991e9fb77a72/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.894606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a8be7-9ba4-49da-9944-b1dfc71901da admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.895153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a8be7-9ba4-49da-9944-b1dfc71901da admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.895432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a8be7-9ba4-49da-9944-b1dfc71901da admin admin] PATH_INFO: `/v3/projects/acf431f3c1e846cebc0d460f7f1cd0b5/users/c1b79db34dea454abc59175a4e2cd8a6/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.902702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a8be7-9ba4-49da-9944-b1dfc71901da admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf431f3c1e846cebc0d460f7f1cd0b5, user_id=c1b79db34dea454abc59175a4e2cd8a6, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.909000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a8be7-9ba4-49da-9944-b1dfc71901da admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.914755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1a0f6-b100-461f-850c-743bd575eb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75aee4f8b1e54d3da43effff671c5c10, user_id=e27664b08c2d43388dc8991e9fb77a72, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:11.917875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1a0f6-b100-461f-850c-743bd575eb95 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:11.929726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 824/1636] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:11 2022] PUT /identity/v3/projects/acf431f3c1e846cebc0d460f7f1cd0b5/users/c1b79db34dea454abc59175a4e2cd8a6/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:11.943005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55a0a-45b5-45e8-8d4f-4f4362daa8d7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:11.943405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55a0a-45b5-45e8-8d4f-4f4362daa8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:11.943747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55a0a-45b5-45e8-8d4f-4f4362daa8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:11.980736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8db55a0a-45b5-45e8-8d4f-4f4362daa8d7 None None] MFA Rules not processed for user `c1b79db34dea454abc59175a4e2cd8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:11.986755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8db55a0a-45b5-45e8-8d4f-4f4362daa8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:12.023542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 813/1637] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:11 2022] PUT /identity/v3/projects/75aee4f8b1e54d3da43effff671c5c10/users/e27664b08c2d43388dc8991e9fb77a72/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:12.028866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a0f6-b100-461f-850c-743bd575eb95 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:12.191900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 825/1638] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:12.197590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db55a0a-45b5-45e8-8d4f-4f4362daa8d7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:12.218814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a0f6-b100-461f-850c-743bd575eb95 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:12.234051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d8cce-cf63-4b6e-8262-c7907e9cff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:12.236227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8cce-cf63-4b6e-8262-c7907e9cff0f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:12.236227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8cce-cf63-4b6e-8262-c7907e9cff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:12.239423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d8cce-cf63-4b6e-8262-c7907e9cff0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:12.257723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d8cce-cf63-4b6e-8262-c7907e9cff0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:12.257723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d8cce-cf63-4b6e-8262-c7907e9cff0f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:12.279197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 814/1639] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:12.280256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d8cce-cf63-4b6e-8262-c7907e9cff0f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:12.324773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:12.337271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:12.342908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db55a0a-45b5-45e8-8d4f-4f4362daa8d7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:12.348418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:12.349400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:12.349716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:12.350133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] PATH_INFO: `/v3/users/a46c4b99af5d48a98148392d95e89f1a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:12.351378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46c4b99af5d48a98148392d95e89f1a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:12.352637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: WARNING py.warnings [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:40:12.352637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: warnings.warn(msg) Jun 15 00:40:12.352637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: Jun 15 00:40:12.353715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:12.387871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d8cce-cf63-4b6e-8262-c7907e9cff0f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:12.393543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0962f-c34a-498e-a3a1-d68da434b609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:12.394311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0962f-c34a-498e-a3a1-d68da434b609 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:12.394538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0962f-c34a-498e-a3a1-d68da434b609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:12.394847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0962f-c34a-498e-a3a1-d68da434b609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:12.496304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0962f-c34a-498e-a3a1-d68da434b609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:12.497872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0962f-c34a-498e-a3a1-d68da434b609 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:12.508320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 815/1640] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:12.511394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0962f-c34a-498e-a3a1-d68da434b609 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:12.522566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0962f-c34a-498e-a3a1-d68da434b609 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:12.531483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9cf3c-d578-4899-b741-2be3443a853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:12.534647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9cf3c-d578-4899-b741-2be3443a853e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:12.534647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9cf3c-d578-4899-b741-2be3443a853e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:12.534647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9cf3c-d578-4899-b741-2be3443a853e admin admin] PATH_INFO: `/v3/projects/75aee4f8b1e54d3da43effff671c5c10/users/e27664b08c2d43388dc8991e9fb77a72/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:12.536037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9cf3c-d578-4899-b741-2be3443a853e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75aee4f8b1e54d3da43effff671c5c10, user_id=e27664b08c2d43388dc8991e9fb77a72, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:12.552651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9cf3c-d578-4899-b741-2be3443a853e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:12.568521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 816/1641] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:12 2022] PUT /identity/v3/projects/75aee4f8b1e54d3da43effff671c5c10/users/e27664b08c2d43388dc8991e9fb77a72/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:12.582511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408db2-2214-4262-94b3-efacc79a7b35 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:12.582799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408db2-2214-4262-94b3-efacc79a7b35 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:12.583072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408db2-2214-4262-94b3-efacc79a7b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:12.614818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-26408db2-2214-4262-94b3-efacc79a7b35 None None] MFA Rules not processed for user `e27664b08c2d43388dc8991e9fb77a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:12.618024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-26408db2-2214-4262-94b3-efacc79a7b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:12.694402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46c4b99af5d48a98148392d95e89f1a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:12.730191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46c4b99af5d48a98148392d95e89f1a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:12.747700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 817/1642] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:12 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:12.850520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46c4b99af5d48a98148392d95e89f1a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:12.851269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46c4b99af5d48a98148392d95e89f1a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:12.871869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408db2-2214-4262-94b3-efacc79a7b35 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:12.877150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d5dacd3-97a1-4dde-91e3-976a74064136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46c4b99af5d48a98148392d95e89f1a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:12.907666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 826/1643] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:12 2022] DELETE /identity/v3/users/a46c4b99af5d48a98148392d95e89f1a => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:12.909354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979d98-b197-4152-aeb5-aa35ccc41b5a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:12.910427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979d98-b197-4152-aeb5-aa35ccc41b5a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:12.910729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979d98-b197-4152-aeb5-aa35ccc41b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:12.935958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:12.956912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-82979d98-b197-4152-aeb5-aa35ccc41b5a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:12.959149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-82979d98-b197-4152-aeb5-aa35ccc41b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:12.968930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408db2-2214-4262-94b3-efacc79a7b35 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:13.038230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 827/1644] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:13.060379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979d98-b197-4152-aeb5-aa35ccc41b5a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:13.068348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-82979d98-b197-4152-aeb5-aa35ccc41b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.090060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b263eb1-78c5-445e-89dd-2e1fd11d0551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:13.090864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b263eb1-78c5-445e-89dd-2e1fd11d0551 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:13.091194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b263eb1-78c5-445e-89dd-2e1fd11d0551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:13.091529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b263eb1-78c5-445e-89dd-2e1fd11d0551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.093581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5b263eb1-78c5-445e-89dd-2e1fd11d0551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.157037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979d98-b197-4152-aeb5-aa35ccc41b5a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:13.164805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:13.165679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:13.166294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:13.166634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.180466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:13.182240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b263eb1-78c5-445e-89dd-2e1fd11d0551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:13.182394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:13.183844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b263eb1-78c5-445e-89dd-2e1fd11d0551 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:13.195435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 818/1645] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:12 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:13.197071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c358a4-89ad-4f25-97a2-b543a770889b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:13.197301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c358a4-89ad-4f25-97a2-b543a770889b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:13.197580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c358a4-89ad-4f25-97a2-b543a770889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.198186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 828/1646] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:13.264009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-27c358a4-89ad-4f25-97a2-b543a770889b None None] MFA Rules not processed for user `4acef8b517cc41e684dfa9b3a765edb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:13.266196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:13.266863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-27c358a4-89ad-4f25-97a2-b543a770889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.268106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.285141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58620c-ea5c-4c51-9485-e00f230a9dbe service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:13.293515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:13.294734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:13.294734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:13.294734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.300557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.315714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:13.365417 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:13.380228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:13.409966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 819/1648] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:13.411499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029d454-78b8-4576-b4da-f37acfe04a94 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:13.411797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029d454-78b8-4576-b4da-f37acfe04a94 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:13.412144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029d454-78b8-4576-b4da-f37acfe04a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.417809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 829/1648] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:13.432315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2029d454-78b8-4576-b4da-f37acfe04a94 None None] MFA Rules not processed for user `4acef8b517cc41e684dfa9b3a765edb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:13.433691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2029d454-78b8-4576-b4da-f37acfe04a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.446373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 820/1649] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:13.463791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:13.465393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.640993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b82a6-329e-4ebb-8890-498dc56d6a01 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:13.663049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:13.663892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:13.664380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:13.664675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.687358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:13.692635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:13.713590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029d454-78b8-4576-b4da-f37acfe04a94 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:13.715026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2029d454-78b8-4576-b4da-f37acfe04a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.719091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 830/1650] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:13.727970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029d454-78b8-4576-b4da-f37acfe04a94 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:13.746211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e7115-f41e-4863-9176-a997c74cfd68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:13.752912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e7115-f41e-4863-9176-a997c74cfd68 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:13.752912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e7115-f41e-4863-9176-a997c74cfd68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:13.752912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e7115-f41e-4863-9176-a997c74cfd68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.752912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-684e7115-f41e-4863-9176-a997c74cfd68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.787848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:13.850148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e7115-f41e-4863-9176-a997c74cfd68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:13.854159 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e7115-f41e-4863-9176-a997c74cfd68 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:13.867891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 821/1651] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:14.762349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:14.762349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:14.762349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46adce-ae59-406e-8a78-6f8e2a4634d6 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:14.765034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:14.765034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:14.765034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:14.765034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] PATH_INFO: `/v3/projects/1e1466c2e8504a34812a807bb0d1f077` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:14.766010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1466c2e8504a34812a807bb0d1f077)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:14.766129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533422f-5ab1-40ab-bc02-2750db698fc3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:14.766129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533422f-5ab1-40ab-bc02-2750db698fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:14.766129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533422f-5ab1-40ab-bc02-2750db698fc3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:14.766129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 822/1652] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jun 15 00:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:14.769568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:14.769938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7098-a28c-4df1-ae74-8a40d91c9a36 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:14.769938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7098-a28c-4df1-ae74-8a40d91c9a36 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:14.769938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a7098-a28c-4df1-ae74-8a40d91c9a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:14.800856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e07a7098-a28c-4df1-ae74-8a40d91c9a36 None None] MFA Rules not processed for user `1eaffae68edd4031ac771310b7d645cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:14.802477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e07a7098-a28c-4df1-ae74-8a40d91c9a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:14.814912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1466c2e8504a34812a807bb0d1f077', 'request_id': 'req-94c5e12e-9715-40fe-b95f-90dd5942f016'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:14.828231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1466c2e8504a34812a807bb0d1f077', 'request_id': 'req-94c5e12e-9715-40fe-b95f-90dd5942f016'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:14.862657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1466c2e8504a34812a807bb0d1f077', 'request_id': 'req-94c5e12e-9715-40fe-b95f-90dd5942f016'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:14.911649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 823/1653] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:40:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:14.929639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a7098-a28c-4df1-ae74-8a40d91c9a36 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:14.932736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e07a7098-a28c-4df1-ae74-8a40d91c9a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:14.946721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a7098-a28c-4df1-ae74-8a40d91c9a36 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:14.951377 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fc2db-153e-4e23-8e52-c2cf66dc4437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:14.952118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc2db-153e-4e23-8e52-c2cf66dc4437 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:14.952395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc2db-153e-4e23-8e52-c2cf66dc4437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:14.952859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fc2db-153e-4e23-8e52-c2cf66dc4437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:14.963364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fc2db-153e-4e23-8e52-c2cf66dc4437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:14.965153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fc2db-153e-4e23-8e52-c2cf66dc4437 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:14.975503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 824/1654] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:15.026877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] The token cache is being invalidate because project 1e1466c2e8504a34812a807bb0d1f077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:15.028603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:15.031415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94c5e12e-9715-40fe-b95f-90dd5942f016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:15.040837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 831/1655] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:14 2022] DELETE /identity/v3/projects/1e1466c2e8504a34812a807bb0d1f077 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:15.042994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dde423-29bc-466e-aff6-5d9fbdc73cbb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:15.044311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dde423-29bc-466e-aff6-5d9fbdc73cbb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:15.044788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dde423-29bc-466e-aff6-5d9fbdc73cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:15.081062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-08dde423-29bc-466e-aff6-5d9fbdc73cbb None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:15.083071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-08dde423-29bc-466e-aff6-5d9fbdc73cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:15.196920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 825/1656] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:15.204560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c8e1-1eec-418c-8ad1-57900fd53d97 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:15.204855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c8e1-1eec-418c-8ad1-57900fd53d97 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:15.205501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c8e1-1eec-418c-8ad1-57900fd53d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:15.236231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5b94c8e1-1eec-418c-8ad1-57900fd53d97 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:15.237200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5b94c8e1-1eec-418c-8ad1-57900fd53d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:15.248526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 832/1657] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:15.253090 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dde423-29bc-466e-aff6-5d9fbdc73cbb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:15.295562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dde423-29bc-466e-aff6-5d9fbdc73cbb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:15.321114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:15.325017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:15.325017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:15.325017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:15.331129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:15.332746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:15.336374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:15.373513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 826/1658] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:15.378149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c8e1-1eec-418c-8ad1-57900fd53d97 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:15.393525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c8e1-1eec-418c-8ad1-57900fd53d97 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:15.426920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ebf3a-499e-4896-863b-06e99a38451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:15.427616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ebf3a-499e-4896-863b-06e99a38451b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:15.427920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ebf3a-499e-4896-863b-06e99a38451b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:15.434044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ebf3a-499e-4896-863b-06e99a38451b admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:15.439801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ebf3a-499e-4896-863b-06e99a38451b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:15.443499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ebf3a-499e-4896-863b-06e99a38451b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:15.470639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:15.584331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 833/1659] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:15 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:15.588176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:15.636888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0693d-c8d5-4125-806f-7ef36bea3ca6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:15.754896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:15.875225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa322-f625-497b-9f03-4ae7f966616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:15.875225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa322-f625-497b-9f03-4ae7f966616c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:15.875225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa322-f625-497b-9f03-4ae7f966616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:15.875225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa322-f625-497b-9f03-4ae7f966616c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:15.876174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa322-f625-497b-9f03-4ae7f966616c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:15.878551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa322-f625-497b-9f03-4ae7f966616c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:16.024465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 827/1660] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:15 2022] POST /identity/v3/users => generated 283 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:16.029256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ebf3a-499e-4896-863b-06e99a38451b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:16.075173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ebf3a-499e-4896-863b-06e99a38451b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:16.084392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0efbb0-2377-405d-aba2-1c5e713d3771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:16.085573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0efbb0-2377-405d-aba2-1c5e713d3771 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:16.085944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0efbb0-2377-405d-aba2-1c5e713d3771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:16.086227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0efbb0-2377-405d-aba2-1c5e713d3771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:16.087044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0efbb0-2377-405d-aba2-1c5e713d3771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:16.090017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0efbb0-2377-405d-aba2-1c5e713d3771 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:16.105026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 834/1661] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:16.109158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa322-f625-497b-9f03-4ae7f966616c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:16.122279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa322-f625-497b-9f03-4ae7f966616c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:16.127876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:16.128813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:16.129110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:16.129388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:16.130138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:16.135018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:16.169988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 828/1662] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:16.173369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0efbb0-2377-405d-aba2-1c5e713d3771 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:16.264943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0efbb0-2377-405d-aba2-1c5e713d3771 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:16.285664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a06d4-97a5-4401-8edd-13c33cdb8ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:16.286764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a06d4-97a5-4401-8edd-13c33cdb8ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:16.287705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a06d4-97a5-4401-8edd-13c33cdb8ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:16.288329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a06d4-97a5-4401-8edd-13c33cdb8ebf admin admin] PATH_INFO: `/v3/projects/417e880638634808b93724f84e2cd0f2/users/ef16ee07c7a54156933b169b718b7798/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:16.350798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a06d4-97a5-4401-8edd-13c33cdb8ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=417e880638634808b93724f84e2cd0f2, user_id=ef16ee07c7a54156933b169b718b7798, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:16.354067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a06d4-97a5-4401-8edd-13c33cdb8ebf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:16.376710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:16.377756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:16.494075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 835/1663] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:16 2022] PUT /identity/v3/projects/417e880638634808b93724f84e2cd0f2/users/ef16ee07c7a54156933b169b718b7798/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:16.505445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97357-440a-49c1-a654-2572100de59b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:16.514706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97357-440a-49c1-a654-2572100de59b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:16.514706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97357-440a-49c1-a654-2572100de59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:16.548730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2383f-b602-4bb2-ac0d-7c8430b6a45a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:16.589919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b8d97357-440a-49c1-a654-2572100de59b None None] MFA Rules not processed for user `ef16ee07c7a54156933b169b718b7798`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:16.591316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b8d97357-440a-49c1-a654-2572100de59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:16.668051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:16.668731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:16.669466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:16.669762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:16.672352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:16.698641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:16.700435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:16.716727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 829/1664] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:16.813264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 836/1665] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:16.814389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:16.939045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:16.968367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868fbb6-4017-4abd-b75c-04f48944bb3e service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:16.979857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b6685-5325-43ad-ab9f-6b15c46e3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:16.980894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6685-5325-43ad-ab9f-6b15c46e3f1d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:16.981104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6685-5325-43ad-ab9f-6b15c46e3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:16.981451 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6685-5325-43ad-ab9f-6b15c46e3f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:16.982219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b6685-5325-43ad-ab9f-6b15c46e3f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:16.984590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b6685-5325-43ad-ab9f-6b15c46e3f1d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:17.725149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 830/1666] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:16 2022] POST /identity/v3/projects => generated 363 bytes in 909 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:17.727872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d97357-440a-49c1-a654-2572100de59b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:17.761549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d97357-440a-49c1-a654-2572100de59b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:17.925786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fca85-c850-41c4-9d58-83a7661a278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:17.928725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fca85-c850-41c4-9d58-83a7661a278a admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:17.928725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fca85-c850-41c4-9d58-83a7661a278a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:17.928725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fca85-c850-41c4-9d58-83a7661a278a admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:17.928725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fca85-c850-41c4-9d58-83a7661a278a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:17.936520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fca85-c850-41c4-9d58-83a7661a278a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:18.043620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 837/1667] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:17 2022] POST /identity/v3/users => generated 288 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:18.047344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b6685-5325-43ad-ab9f-6b15c46e3f1d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:18.059235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b6685-5325-43ad-ab9f-6b15c46e3f1d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:18.064155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ea97f-72e6-41cf-ab4c-5d2fba89a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:18.065484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea97f-72e6-41cf-ab4c-5d2fba89a13b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:18.065484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea97f-72e6-41cf-ab4c-5d2fba89a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:18.065484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea97f-72e6-41cf-ab4c-5d2fba89a13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:18.066170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ea97f-72e6-41cf-ab4c-5d2fba89a13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:18.068106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ea97f-72e6-41cf-ab4c-5d2fba89a13b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:18.085390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fca85-c850-41c4-9d58-83a7661a278a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:18.092128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 831/1668] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:18.099287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fca85-c850-41c4-9d58-83a7661a278a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:18.106131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c34e-f5f3-4607-875b-171de2cd9b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:18.107201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c34e-f5f3-4607-875b-171de2cd9b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:18.107591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c34e-f5f3-4607-875b-171de2cd9b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:18.107953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c34e-f5f3-4607-875b-171de2cd9b88 admin admin] PATH_INFO: `/v3/projects/a138e53d325f4464b2b52a3857beeba1/users/ff2c482bffc4400e9037b90f1bf4dc30/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:18.153480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4c34e-f5f3-4607-875b-171de2cd9b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a138e53d325f4464b2b52a3857beeba1, user_id=ff2c482bffc4400e9037b90f1bf4dc30, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:18.158271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4c34e-f5f3-4607-875b-171de2cd9b88 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:18.250886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ea97f-72e6-41cf-ab4c-5d2fba89a13b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:18.251555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 838/1669] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:18 2022] PUT /identity/v3/projects/a138e53d325f4464b2b52a3857beeba1/users/ff2c482bffc4400e9037b90f1bf4dc30/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:18.264925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ea97f-72e6-41cf-ab4c-5d2fba89a13b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:18.373715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc66076-8d09-4ec4-9d84-2e837bdf0db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:18.374681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66076-8d09-4ec4-9d84-2e837bdf0db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:18.375070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66076-8d09-4ec4-9d84-2e837bdf0db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:18.375549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc66076-8d09-4ec4-9d84-2e837bdf0db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:18.377075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc66076-8d09-4ec4-9d84-2e837bdf0db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:18.379029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc66076-8d09-4ec4-9d84-2e837bdf0db0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:18.395992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 832/1670] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:18.398319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c34e-f5f3-4607-875b-171de2cd9b88 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:18.415840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c34e-f5f3-4607-875b-171de2cd9b88 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:18.426825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:18.428036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:18.428311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:18.429439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] PATH_INFO: `/v3/projects/a138e53d325f4464b2b52a3857beeba1/users/ff2c482bffc4400e9037b90f1bf4dc30/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:18.432443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a138e53d325f4464b2b52a3857beeba1, user_id=ff2c482bffc4400e9037b90f1bf4dc30, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:18.435577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:18.461035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 839/1671] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:18 2022] PUT /identity/v3/projects/a138e53d325f4464b2b52a3857beeba1/users/ff2c482bffc4400e9037b90f1bf4dc30/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:18.472517 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db976dd-9e75-492b-bada-7ea7044ed498 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:18.472802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db976dd-9e75-492b-bada-7ea7044ed498 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:18.473246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db976dd-9e75-492b-bada-7ea7044ed498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:18.537301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4db976dd-9e75-492b-bada-7ea7044ed498 None None] MFA Rules not processed for user `ff2c482bffc4400e9037b90f1bf4dc30`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:18.538559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4db976dd-9e75-492b-bada-7ea7044ed498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:18.791987 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 833/1672] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:18.838421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:18.845178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:18.850985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:18.853263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db976dd-9e75-492b-bada-7ea7044ed498 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:18.855260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4db976dd-9e75-492b-bada-7ea7044ed498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:18.992449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:19.017170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db976dd-9e75-492b-bada-7ea7044ed498 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:19.030894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a853b0f-5c6d-435e-a75b-dabcf8cbba61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:19.031563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853b0f-5c6d-435e-a75b-dabcf8cbba61 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:19.031922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853b0f-5c6d-435e-a75b-dabcf8cbba61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:19.032720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853b0f-5c6d-435e-a75b-dabcf8cbba61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:19.035994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a5f9-175e-4e62-8003-79aebb1161a4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:19.058312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:19.059206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:19.059485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:19.064384 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] PATH_INFO: `/v3/users/927eff6c108d424db27862b86671c15a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:19.068611 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a853b0f-5c6d-435e-a75b-dabcf8cbba61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:19.069866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=927eff6c108d424db27862b86671c15a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:19.072624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a853b0f-5c6d-435e-a75b-dabcf8cbba61 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:19.078025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:19.106576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 834/1673] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:19.334544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927eff6c108d424db27862b86671c15a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:19.370157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927eff6c108d424db27862b86671c15a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:19.465182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927eff6c108d424db27862b86671c15a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:19.465912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927eff6c108d424db27862b86671c15a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:19.492710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927eff6c108d424db27862b86671c15a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:19.515936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 840/1674] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:18 2022] DELETE /identity/v3/users/927eff6c108d424db27862b86671c15a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:19.521546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7a43-6868-4f3b-8175-97f2f8fa21dc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:19.522120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7a43-6868-4f3b-8175-97f2f8fa21dc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:19.522497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7a43-6868-4f3b-8175-97f2f8fa21dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:19.570025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-36fe7a43-6868-4f3b-8175-97f2f8fa21dc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:19.574079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-36fe7a43-6868-4f3b-8175-97f2f8fa21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:19.786025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 835/1675] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:19.814433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:19.815948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:19.917811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dd24f-b263-4fa4-8c5a-0868fb069041 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:19.927945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e544b-4504-41b6-a135-c0282c125d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:19.928622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e544b-4504-41b6-a135-c0282c125d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:19.928925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e544b-4504-41b6-a135-c0282c125d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:19.929192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e544b-4504-41b6-a135-c0282c125d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:19.951960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e544b-4504-41b6-a135-c0282c125d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:19.953598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e544b-4504-41b6-a135-c0282c125d7f service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:19.977038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 841/1676] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:21.084899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7a43-6868-4f3b-8175-97f2f8fa21dc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:21.087637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-36fe7a43-6868-4f3b-8175-97f2f8fa21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:21.108172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7a43-6868-4f3b-8175-97f2f8fa21dc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:21.120931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:21.122474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:21.122997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:21.123495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] PATH_INFO: `/v3/users/ef16ee07c7a54156933b169b718b7798` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:21.130014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef16ee07c7a54156933b169b718b7798)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:21.134150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:21.377813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef16ee07c7a54156933b169b718b7798'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:21.533275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef16ee07c7a54156933b169b718b7798'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:21.558168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef16ee07c7a54156933b169b718b7798'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:21.559548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef16ee07c7a54156933b169b718b7798'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:21.577729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef16ee07c7a54156933b169b718b7798'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:21.595829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 836/1677] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:21 2022] DELETE /identity/v3/users/ef16ee07c7a54156933b169b718b7798 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:21.600059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ee105-5c92-4755-b97b-8162dac7efc9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:21.600943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ee105-5c92-4755-b97b-8162dac7efc9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:21.601382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ee105-5c92-4755-b97b-8162dac7efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:21.635088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ba8ee105-5c92-4755-b97b-8162dac7efc9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:21.636611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ba8ee105-5c92-4755-b97b-8162dac7efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:21.680529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:21.697923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:21.700025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:21.792620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 842/1678] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:21.859740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ee105-5c92-4755-b97b-8162dac7efc9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:21.862959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ba8ee105-5c92-4755-b97b-8162dac7efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:21.934312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:21.940150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f5b8f-5430-46f3-9f64-4f21583ee3de admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:21.948849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:21.950044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:21.950651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:21.950651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] PATH_INFO: `/v3/projects/d5d0b6a397e844c0b4260544cd69dfee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:21.952041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d0b6a397e844c0b4260544cd69dfee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:21.953131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: WARNING py.warnings [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:40:21.953131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: warnings.warn(msg) Jun 15 00:40:21.953131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: Jun 15 00:40:21.955419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:22.002367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ee105-5c92-4755-b97b-8162dac7efc9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:22.011941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af186477-879d-411e-8a44-2b7237a4ace6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:22.012871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186477-879d-411e-8a44-2b7237a4ace6 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:22.013260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186477-879d-411e-8a44-2b7237a4ace6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:22.013729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186477-879d-411e-8a44-2b7237a4ace6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:22.031789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186477-879d-411e-8a44-2b7237a4ace6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:22.034109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186477-879d-411e-8a44-2b7237a4ace6 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:22.056935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 843/1679] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:22.173102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d0b6a397e844c0b4260544cd69dfee', 'request_id': 'req-2322c375-f73a-4ac6-b474-ad8116271a9a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:22.198240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d0b6a397e844c0b4260544cd69dfee', 'request_id': 'req-2322c375-f73a-4ac6-b474-ad8116271a9a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:22.233887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d0b6a397e844c0b4260544cd69dfee', 'request_id': 'req-2322c375-f73a-4ac6-b474-ad8116271a9a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:22.339740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] The token cache is being invalidate because project d5d0b6a397e844c0b4260544cd69dfee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:22.340131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:22.343131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2322c375-f73a-4ac6-b474-ad8116271a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:22.347260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 837/1680] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:21 2022] DELETE /identity/v3/projects/d5d0b6a397e844c0b4260544cd69dfee => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:22.353412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eb6b7-d6e5-40fd-b8ed-d16b8ec82750 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:22.356010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eb6b7-d6e5-40fd-b8ed-d16b8ec82750 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:22.356010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eb6b7-d6e5-40fd-b8ed-d16b8ec82750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:22.405456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a39eb6b7-d6e5-40fd-b8ed-d16b8ec82750 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:22.408032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a39eb6b7-d6e5-40fd-b8ed-d16b8ec82750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:22.574392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 844/1681] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:22.589055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b739b-80f2-468d-9ece-f902d79419e3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:22.589338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b739b-80f2-468d-9ece-f902d79419e3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:22.589694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b739b-80f2-468d-9ece-f902d79419e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:22.632548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3f5b739b-80f2-468d-9ece-f902d79419e3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:22.636465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3f5b739b-80f2-468d-9ece-f902d79419e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:22.666039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 838/1682] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:22.667315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eb6b7-d6e5-40fd-b8ed-d16b8ec82750 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:22.682987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eb6b7-d6e5-40fd-b8ed-d16b8ec82750 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:22.704570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e4693-cd46-44e0-8105-e934b290b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:22.704570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4693-cd46-44e0-8105-e934b290b27b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:22.704570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4693-cd46-44e0-8105-e934b290b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:22.704570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e4693-cd46-44e0-8105-e934b290b27b admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:22.706984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e4693-cd46-44e0-8105-e934b290b27b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:22.707393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e4693-cd46-44e0-8105-e934b290b27b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:22.709949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e4693-cd46-44e0-8105-e934b290b27b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:22.756323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 845/1683] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:22.761048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b739b-80f2-468d-9ece-f902d79419e3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:22.780852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b739b-80f2-468d-9ece-f902d79419e3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:22.794080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:22.794178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:22.794450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:22.798719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:22.800002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:22.803706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:22.835057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c957-3a0e-417e-8467-4db9883b2a3f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:22.835371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c957-3a0e-417e-8467-4db9883b2a3f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:22.835686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82c957-3a0e-417e-8467-4db9883b2a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:22.868934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-df82c957-3a0e-417e-8467-4db9883b2a3f None None] MFA Rules not processed for user `d9a0bbb1f50c42acb50dac254a653da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:22.870157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-df82c957-3a0e-417e-8467-4db9883b2a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:22.945638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 846/1684] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:22.958757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 839/1685] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:22 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:22.962764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82c957-3a0e-417e-8467-4db9883b2a3f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:22.970168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:22.972145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:22.984223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82c957-3a0e-417e-8467-4db9883b2a3f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:23.039467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:23.068345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a230d-dcc0-4174-9008-80344cf29d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:23.069240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a230d-dcc0-4174-9008-80344cf29d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:23.069805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a230d-dcc0-4174-9008-80344cf29d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:23.071583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a230d-dcc0-4174-9008-80344cf29d01 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:23.071583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a230d-dcc0-4174-9008-80344cf29d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:23.073080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a230d-dcc0-4174-9008-80344cf29d01 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:23.162109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90524c91-42d4-490b-8d35-2d776957f7d8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:23.168775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1be956-cf10-4183-968b-7415c3167b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:23.169883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be956-cf10-4183-968b-7415c3167b70 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:23.171135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be956-cf10-4183-968b-7415c3167b70 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:23.171624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be956-cf10-4183-968b-7415c3167b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:23.191803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 847/1686] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:22 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:23.199690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a230d-dcc0-4174-9008-80344cf29d01 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:23.216549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a230d-dcc0-4174-9008-80344cf29d01 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:23.223304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae7cbe-143e-4061-bcf8-d8d00c3a1124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:23.224313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7cbe-143e-4061-bcf8-d8d00c3a1124 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:23.224827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7cbe-143e-4061-bcf8-d8d00c3a1124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:23.225467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7cbe-143e-4061-bcf8-d8d00c3a1124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:23.226414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae7cbe-143e-4061-bcf8-d8d00c3a1124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:23.228425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae7cbe-143e-4061-bcf8-d8d00c3a1124 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:23.241973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 848/1687] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:23.247863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae7cbe-143e-4061-bcf8-d8d00c3a1124 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:23.275082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae7cbe-143e-4061-bcf8-d8d00c3a1124 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:23.289516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29570047-c470-41c5-8dfb-e07ce528bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:23.289718 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29570047-c470-41c5-8dfb-e07ce528bdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:23.291138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29570047-c470-41c5-8dfb-e07ce528bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:23.291431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29570047-c470-41c5-8dfb-e07ce528bdb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:23.292400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29570047-c470-41c5-8dfb-e07ce528bdb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:23.298238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29570047-c470-41c5-8dfb-e07ce528bdb1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:23.335468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1be956-cf10-4183-968b-7415c3167b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:23.337127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1be956-cf10-4183-968b-7415c3167b70 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:23.346130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 849/1688] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:23.347074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29570047-c470-41c5-8dfb-e07ce528bdb1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:23.373127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29570047-c470-41c5-8dfb-e07ce528bdb1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:23.380125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 840/1689] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:23.391678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:23.392608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:23.392889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:23.393159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] PATH_INFO: `/v3/projects/2dc65227e51e4d4ebece29dfdea6f125/users/18866a01b6e84fcf828c9ef14465537e/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:23.456860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc65227e51e4d4ebece29dfdea6f125, user_id=18866a01b6e84fcf828c9ef14465537e, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:23.462041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:23.612721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:23.615321 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 850/1690] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:23 2022] PUT /identity/v3/projects/2dc65227e51e4d4ebece29dfdea6f125/users/18866a01b6e84fcf828c9ef14465537e/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:23.628975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa994bb-b65a-40d8-af15-da0f19310e09 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:23.628975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa994bb-b65a-40d8-af15-da0f19310e09 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:23.628975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa994bb-b65a-40d8-af15-da0f19310e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:23.691236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8aa994bb-b65a-40d8-af15-da0f19310e09 None None] MFA Rules not processed for user `18866a01b6e84fcf828c9ef14465537e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:23.695153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8aa994bb-b65a-40d8-af15-da0f19310e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:23.835064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 841/1691] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:23.851622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:23.853518 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:23.869108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa994bb-b65a-40d8-af15-da0f19310e09 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:23.870911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8aa994bb-b65a-40d8-af15-da0f19310e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:24.096172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398ccf-db9a-4cde-82dc-f7f41c63441b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:24.108522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f9e63-3ca4-49ac-abf1-baec6d769ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:24.109201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9e63-3ca4-49ac-abf1-baec6d769ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:24.120751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9e63-3ca4-49ac-abf1-baec6d769ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:24.121260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f9e63-3ca4-49ac-abf1-baec6d769ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:24.158513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa994bb-b65a-40d8-af15-da0f19310e09 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:24.164373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f9e63-3ca4-49ac-abf1-baec6d769ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:24.165943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f9e63-3ca4-49ac-abf1-baec6d769ae2 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:24.175678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:24.177675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:24.182810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:24.183244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] PATH_INFO: `/v3/projects/417e880638634808b93724f84e2cd0f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:24.186234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417e880638634808b93724f84e2cd0f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:24.202214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:24.286890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 851/1692] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:24.293829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3170dbb-791d-4430-a63f-17198fa7e79d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:24.294201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3170dbb-791d-4430-a63f-17198fa7e79d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:24.294591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3170dbb-791d-4430-a63f-17198fa7e79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:24.399866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417e880638634808b93724f84e2cd0f2', 'request_id': 'req-80d76f1e-2104-44d8-9acb-0ac0640ff217'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:24.408306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417e880638634808b93724f84e2cd0f2', 'request_id': 'req-80d76f1e-2104-44d8-9acb-0ac0640ff217'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:24.417624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417e880638634808b93724f84e2cd0f2', 'request_id': 'req-80d76f1e-2104-44d8-9acb-0ac0640ff217'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:24.450491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c3170dbb-791d-4430-a63f-17198fa7e79d None None] MFA Rules not processed for user `2ff9f53decbc44ce9166f6c841e8ea02`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:24.456186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c3170dbb-791d-4430-a63f-17198fa7e79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:24.488795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] The token cache is being invalidate because project 417e880638634808b93724f84e2cd0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:24.491724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:24.491724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:24.494949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 842/1693] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:23 2022] DELETE /identity/v3/projects/417e880638634808b93724f84e2cd0f2 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:24.497855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:24.502120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:24.536579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:24.608661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 852/1694] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:24.629686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3170dbb-791d-4430-a63f-17198fa7e79d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:24.633242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c3170dbb-791d-4430-a63f-17198fa7e79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:24.768963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d76f1e-2104-44d8-9acb-0ac0640ff217 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:24.788078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:24.788967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:24.789251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:24.789529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] PATH_INFO: `/v3/users/ff2c482bffc4400e9037b90f1bf4dc30` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:24.790971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2c482bffc4400e9037b90f1bf4dc30)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:24.792971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:24.818574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3170dbb-791d-4430-a63f-17198fa7e79d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:24.834628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a9e9d-b240-45ee-9722-d1f9423480b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:24.834628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9e9d-b240-45ee-9722-d1f9423480b9 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:24.834628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9e9d-b240-45ee-9722-d1f9423480b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:24.834829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9e9d-b240-45ee-9722-d1f9423480b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:24.853713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a9e9d-b240-45ee-9722-d1f9423480b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:24.861376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a9e9d-b240-45ee-9722-d1f9423480b9 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:24.889583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 853/1695] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:25.007462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220d710-daff-4007-a594-00eebdfd63c7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:25.007748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220d710-daff-4007-a594-00eebdfd63c7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:25.008091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220d710-daff-4007-a594-00eebdfd63c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:25.055522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2c482bffc4400e9037b90f1bf4dc30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:25.061384 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7220d710-daff-4007-a594-00eebdfd63c7 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:25.065145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7220d710-daff-4007-a594-00eebdfd63c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:25.143462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2c482bffc4400e9037b90f1bf4dc30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:25.175973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2c482bffc4400e9037b90f1bf4dc30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:25.179711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2c482bffc4400e9037b90f1bf4dc30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:25.228655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 854/1696] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:40:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:25.235756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0ac93ef8-a877-45a8-a358-ef5b0ea5164a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2c482bffc4400e9037b90f1bf4dc30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:25.253647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 843/1697] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:24 2022] DELETE /identity/v3/users/ff2c482bffc4400e9037b90f1bf4dc30 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:25.534580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:25.825111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220d710-daff-4007-a594-00eebdfd63c7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:25.826600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7220d710-daff-4007-a594-00eebdfd63c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:25.991768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:26.041501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220d710-daff-4007-a594-00eebdfd63c7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:26.118288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a135-af11-4901-8b33-6abdaed74870 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:26.118734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a135-af11-4901-8b33-6abdaed74870 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:26.119113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a135-af11-4901-8b33-6abdaed74870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:26.164823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4d20a135-af11-4901-8b33-6abdaed74870 None None] MFA Rules not processed for user `4989693e66c44d6a8e5f8543f1b9c516`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:26.166664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4d20a135-af11-4901-8b33-6abdaed74870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:26.277528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:26.279463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:26.279760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:26.280692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 844/1698] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:26.290893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:26.294885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcf461-8a4c-48f5-82c0-4b86f0de8ea8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:26.295047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:26.295549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcf461-8a4c-48f5-82c0-4b86f0de8ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:26.296000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcf461-8a4c-48f5-82c0-4b86f0de8ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:26.327575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-30fcf461-8a4c-48f5-82c0-4b86f0de8ea8 None None] MFA Rules not processed for user `4989693e66c44d6a8e5f8543f1b9c516`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:26.330532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-30fcf461-8a4c-48f5-82c0-4b86f0de8ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:26.341556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 845/1699] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:26.359195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcf461-8a4c-48f5-82c0-4b86f0de8ea8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:26.372998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-30fcf461-8a4c-48f5-82c0-4b86f0de8ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:26.430468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:26.439192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:26.464506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 855/1700] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:40:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:40:26.569961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcf461-8a4c-48f5-82c0-4b86f0de8ea8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:26.592816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54bc3-3e87-479c-b8a7-ea62e805bd35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:26.594057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54bc3-3e87-479c-b8a7-ea62e805bd35 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:26.595075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54bc3-3e87-479c-b8a7-ea62e805bd35 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:26.595844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54bc3-3e87-479c-b8a7-ea62e805bd35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:26.643138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54bc3-3e87-479c-b8a7-ea62e805bd35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:26.650303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54bc3-3e87-479c-b8a7-ea62e805bd35 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:26.676422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 846/1701] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:27.111618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:27.113800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:27.411219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0451-2e40-414b-a2c8-4a1652ee431b service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:27.448089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:27.449226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:27.449557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:27.449864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] PATH_INFO: `/v3/projects/a138e53d325f4464b2b52a3857beeba1` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:27.456057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a138e53d325f4464b2b52a3857beeba1)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:27.462135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:27.659297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:27.693563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a138e53d325f4464b2b52a3857beeba1', 'request_id': 'req-e971838c-17cd-4a29-8b7d-776581852bba'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:27.718729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:27.721795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a138e53d325f4464b2b52a3857beeba1', 'request_id': 'req-e971838c-17cd-4a29-8b7d-776581852bba'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:27.741832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a138e53d325f4464b2b52a3857beeba1', 'request_id': 'req-e971838c-17cd-4a29-8b7d-776581852bba'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:27.878990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] The token cache is being invalidate because project a138e53d325f4464b2b52a3857beeba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:27.878990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:27.878990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e971838c-17cd-4a29-8b7d-776581852bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:27.882627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 856/1702] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:27 2022] DELETE /identity/v3/projects/a138e53d325f4464b2b52a3857beeba1 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:27.888397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f781a9-f812-47e9-b30e-d424c4af3991 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:27.888686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f781a9-f812-47e9-b30e-d424c4af3991 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:27.889002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f781a9-f812-47e9-b30e-d424c4af3991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:27.932474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b0f781a9-f812-47e9-b30e-d424c4af3991 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:27.935169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b0f781a9-f812-47e9-b30e-d424c4af3991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:28.083336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 847/1703] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:28.092106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc73996-d993-4213-a09e-27cc3082f32f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:28.092410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc73996-d993-4213-a09e-27cc3082f32f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:28.092838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc73996-d993-4213-a09e-27cc3082f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:28.135836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3bc73996-d993-4213-a09e-27cc3082f32f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:28.137122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3bc73996-d993-4213-a09e-27cc3082f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:28.193644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 857/1704] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:28.194717 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f781a9-f812-47e9-b30e-d424c4af3991 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:28.218360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f781a9-f812-47e9-b30e-d424c4af3991 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:28.237729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106197-ea87-42c7-8d05-492013e5cda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:28.239019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106197-ea87-42c7-8d05-492013e5cda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:28.239019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106197-ea87-42c7-8d05-492013e5cda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:28.239411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106197-ea87-42c7-8d05-492013e5cda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:28.240372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98106197-ea87-42c7-8d05-492013e5cda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:28.240839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98106197-ea87-42c7-8d05-492013e5cda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:28.242719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98106197-ea87-42c7-8d05-492013e5cda5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:28.292024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 848/1705] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:28.296253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc73996-d993-4213-a09e-27cc3082f32f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:28.307531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc73996-d993-4213-a09e-27cc3082f32f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:28.340853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f7b6-52be-433c-a1a7-afe09bfe6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:28.340853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f7b6-52be-433c-a1a7-afe09bfe6cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:28.340853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f7b6-52be-433c-a1a7-afe09bfe6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:28.340853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5f7b6-52be-433c-a1a7-afe09bfe6cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:28.348277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5f7b6-52be-433c-a1a7-afe09bfe6cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:28.353459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5f7b6-52be-433c-a1a7-afe09bfe6cb1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:28.475355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f044d-e784-4dba-9f70-0e022abff6b7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:28.478831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f044d-e784-4dba-9f70-0e022abff6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:28.478831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f044d-e784-4dba-9f70-0e022abff6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:28.513754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-654f044d-e784-4dba-9f70-0e022abff6b7 None None] MFA Rules not processed for user `1eaffae68edd4031ac771310b7d645cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:28.515295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-654f044d-e784-4dba-9f70-0e022abff6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:28.516103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 858/1706] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:28 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:28.520790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f7b6-52be-433c-a1a7-afe09bfe6cb1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:28.708546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5f7b6-52be-433c-a1a7-afe09bfe6cb1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:28.723529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 849/1707] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Jun 15 00:40:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:28.733168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4595-ff72-4ac1-ad35-dcd88a870330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:28.737406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4595-ff72-4ac1-ad35-dcd88a870330 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:28.737732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4595-ff72-4ac1-ad35-dcd88a870330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:28.738038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c4595-ff72-4ac1-ad35-dcd88a870330 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:28.738770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c4595-ff72-4ac1-ad35-dcd88a870330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:28.752523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c4595-ff72-4ac1-ad35-dcd88a870330 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:28.840068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f044d-e784-4dba-9f70-0e022abff6b7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:28.841769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-654f044d-e784-4dba-9f70-0e022abff6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:28.865890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 859/1708] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:28 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:28.870498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4595-ff72-4ac1-ad35-dcd88a870330 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:28.890173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f044d-e784-4dba-9f70-0e022abff6b7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:28.900699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c4595-ff72-4ac1-ad35-dcd88a870330 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:28.916434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8b0b5-4070-4d1b-b6b3-f4420711b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:28.918601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8b0b5-4070-4d1b-b6b3-f4420711b5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:28.921421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8b0b5-4070-4d1b-b6b3-f4420711b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:28.922314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8b0b5-4070-4d1b-b6b3-f4420711b5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:28.924550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936abebe-25a8-4d27-8254-057fab4bb643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:28.931520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936abebe-25a8-4d27-8254-057fab4bb643 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:28.931869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8b0b5-4070-4d1b-b6b3-f4420711b5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:28.932085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936abebe-25a8-4d27-8254-057fab4bb643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:28.932085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936abebe-25a8-4d27-8254-057fab4bb643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:28.932250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8b0b5-4070-4d1b-b6b3-f4420711b5b4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:28.954834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936abebe-25a8-4d27-8254-057fab4bb643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:28.958037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936abebe-25a8-4d27-8254-057fab4bb643 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:28.983046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 860/1709] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:40:28.984305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8b0b5-4070-4d1b-b6b3-f4420711b5b4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:28.986936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 850/1710] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:29.015756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8b0b5-4070-4d1b-b6b3-f4420711b5b4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:29.021493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2b961-244b-4515-ac04-70b101b8c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:29.022356 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2b961-244b-4515-ac04-70b101b8c71a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:29.022642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2b961-244b-4515-ac04-70b101b8c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:29.022919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2b961-244b-4515-ac04-70b101b8c71a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:29.024406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2b961-244b-4515-ac04-70b101b8c71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:29.026156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2b961-244b-4515-ac04-70b101b8c71a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:29.049174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 861/1711] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:29.053163 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936abebe-25a8-4d27-8254-057fab4bb643 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:29.082786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936abebe-25a8-4d27-8254-057fab4bb643 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:29.100741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e3e84-fd47-4aba-9eab-6e2c36fbab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:29.101799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e3e84-fd47-4aba-9eab-6e2c36fbab0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:29.102297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e3e84-fd47-4aba-9eab-6e2c36fbab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:29.102774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e3e84-fd47-4aba-9eab-6e2c36fbab0e admin admin] PATH_INFO: `/v3/projects/f198e5d0f4ca4f3c8acb99df0cf020d7/users/2305847fbea84ced8f2c1a92ace955df/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:29.152021 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e3e84-fd47-4aba-9eab-6e2c36fbab0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f198e5d0f4ca4f3c8acb99df0cf020d7, user_id=2305847fbea84ced8f2c1a92ace955df, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:29.163306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e3e84-fd47-4aba-9eab-6e2c36fbab0e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:29.270351 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 851/1712] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:29 2022] PUT /identity/v3/projects/f198e5d0f4ca4f3c8acb99df0cf020d7/users/2305847fbea84ced8f2c1a92ace955df/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:29.281060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abac78-a38d-4825-b613-b3ea0fe45917 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:29.281727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abac78-a38d-4825-b613-b3ea0fe45917 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:29.281727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abac78-a38d-4825-b613-b3ea0fe45917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:29.344722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-37abac78-a38d-4825-b613-b3ea0fe45917 None None] MFA Rules not processed for user `2305847fbea84ced8f2c1a92ace955df`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:29.346171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-37abac78-a38d-4825-b613-b3ea0fe45917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:29.549910 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 862/1713] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:29.551398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e3e84-fd47-4aba-9eab-6e2c36fbab0e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:29.576240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:29.769502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e3e84-fd47-4aba-9eab-6e2c36fbab0e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:29.793862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e623a-f914-4bc3-9a7d-61db15401d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:29.794693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e623a-f914-4bc3-9a7d-61db15401d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:29.795003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e623a-f914-4bc3-9a7d-61db15401d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:29.795321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e623a-f914-4bc3-9a7d-61db15401d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:29.796135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e623a-f914-4bc3-9a7d-61db15401d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:29.798685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e623a-f914-4bc3-9a7d-61db15401d78 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:29.951300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 852/1714] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:29 2022] POST /identity/v3/projects => generated 385 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:40:29.956927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abac78-a38d-4825-b613-b3ea0fe45917 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:29.978692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abac78-a38d-4825-b613-b3ea0fe45917 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:30.025249 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ab5f-3061-4faf-962d-98cc39426f5b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:30.025522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ab5f-3061-4faf-962d-98cc39426f5b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:30.025892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ab5f-3061-4faf-962d-98cc39426f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:30.097366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2b40ab5f-3061-4faf-962d-98cc39426f5b None None] MFA Rules not processed for user `4989693e66c44d6a8e5f8543f1b9c516`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:30.110763 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2b40ab5f-3061-4faf-962d-98cc39426f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:30.287158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bead1bf-7b8b-4b10-9eed-86a9f552126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:30.288212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bead1bf-7b8b-4b10-9eed-86a9f552126d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:30.288212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bead1bf-7b8b-4b10-9eed-86a9f552126d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:30.288527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bead1bf-7b8b-4b10-9eed-86a9f552126d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:30.289178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bead1bf-7b8b-4b10-9eed-86a9f552126d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:30.293564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bead1bf-7b8b-4b10-9eed-86a9f552126d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:30.330525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 853/1715] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:30.399949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 863/1716] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:29 2022] POST /identity/v3/users => generated 293 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:30.404398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40ab5f-3061-4faf-962d-98cc39426f5b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:30.450142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40ab5f-3061-4faf-962d-98cc39426f5b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:30.466411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964000d-a151-435f-ac66-046a7d0ea194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:30.468167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964000d-a151-435f-ac66-046a7d0ea194 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:30.468616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964000d-a151-435f-ac66-046a7d0ea194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:30.469589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964000d-a151-435f-ac66-046a7d0ea194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:30.470758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964000d-a151-435f-ac66-046a7d0ea194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:30.477228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964000d-a151-435f-ac66-046a7d0ea194 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:30.524589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 854/1717] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:30.531197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bead1bf-7b8b-4b10-9eed-86a9f552126d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:30.557398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bead1bf-7b8b-4b10-9eed-86a9f552126d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:30.603192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba82bac-086a-4bf1-8c16-ac2cf8e0b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:30.603875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82bac-086a-4bf1-8c16-ac2cf8e0b1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:30.604184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82bac-086a-4bf1-8c16-ac2cf8e0b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:30.609745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82bac-086a-4bf1-8c16-ac2cf8e0b1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:30.610618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba82bac-086a-4bf1-8c16-ac2cf8e0b1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:30.612245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba82bac-086a-4bf1-8c16-ac2cf8e0b1fe admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:30.643875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 864/1718] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:30.648110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964000d-a151-435f-ac66-046a7d0ea194 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:30.663736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964000d-a151-435f-ac66-046a7d0ea194 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:30.675403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cc308-f634-4872-8829-e6c98d2f9d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:30.676595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cc308-f634-4872-8829-e6c98d2f9d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:30.681633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cc308-f634-4872-8829-e6c98d2f9d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:30.681633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cc308-f634-4872-8829-e6c98d2f9d8a admin admin] PATH_INFO: `/v3/projects/7efecc2f834c4d7ba1018a2f8a6a620f/users/9cd95b59ad70479281e377864a1d183d/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:30.745534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cc308-f634-4872-8829-e6c98d2f9d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efecc2f834c4d7ba1018a2f8a6a620f, user_id=9cd95b59ad70479281e377864a1d183d, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:30.781170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cc308-f634-4872-8829-e6c98d2f9d8a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:30.802851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:30.982956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 855/1719] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:30 2022] PUT /identity/v3/projects/7efecc2f834c4d7ba1018a2f8a6a620f/users/9cd95b59ad70479281e377864a1d183d/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:30.999570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518ca9-6d39-4926-ac8e-58678f5f1bbc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:30.999570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518ca9-6d39-4926-ac8e-58678f5f1bbc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:30.999570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518ca9-6d39-4926-ac8e-58678f5f1bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:31.164283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ee518ca9-6d39-4926-ac8e-58678f5f1bbc None None] MFA Rules not processed for user `9cd95b59ad70479281e377864a1d183d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:31.168940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ee518ca9-6d39-4926-ac8e-58678f5f1bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:31.535988 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 865/1720] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 542 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:31.539705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cc308-f634-4872-8829-e6c98d2f9d8a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:31.718533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cc308-f634-4872-8829-e6c98d2f9d8a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:31.751672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb079cb2-5a97-4d86-87db-5d069705f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:31.752519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079cb2-5a97-4d86-87db-5d069705f147 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:31.752887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079cb2-5a97-4d86-87db-5d069705f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:31.753343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079cb2-5a97-4d86-87db-5d069705f147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:31.757081 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb079cb2-5a97-4d86-87db-5d069705f147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:31.757401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb079cb2-5a97-4d86-87db-5d069705f147 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:31.919091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee518ca9-6d39-4926-ac8e-58678f5f1bbc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:31.919489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 856/1721] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:31 2022] POST /identity/v3/projects => generated 385 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:31.940764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee518ca9-6d39-4926-ac8e-58678f5f1bbc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:31.990126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a321-4ca9-4b91-8fbe-b74135ef9d00 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:31.990416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a321-4ca9-4b91-8fbe-b74135ef9d00 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:31.990694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a321-4ca9-4b91-8fbe-b74135ef9d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:32.048246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b161a321-4ca9-4b91-8fbe-b74135ef9d00 None None] MFA Rules not processed for user `d9a0bbb1f50c42acb50dac254a653da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:32.049673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b161a321-4ca9-4b91-8fbe-b74135ef9d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:32.169996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034850c-50ef-47ee-a79a-015f852a781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:32.170857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034850c-50ef-47ee-a79a-015f852a781f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:32.172760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034850c-50ef-47ee-a79a-015f852a781f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:32.176520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034850c-50ef-47ee-a79a-015f852a781f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:32.179169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034850c-50ef-47ee-a79a-015f852a781f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:32.187687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034850c-50ef-47ee-a79a-015f852a781f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:32.267794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 857/1722] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:32.334016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 866/1723] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:31 2022] POST /identity/v3/users => generated 299 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:40:32.337727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161a321-4ca9-4b91-8fbe-b74135ef9d00 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:32.364157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161a321-4ca9-4b91-8fbe-b74135ef9d00 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:32.387116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6e4cc-473d-4980-a2e5-36f339ceeffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:32.391420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6e4cc-473d-4980-a2e5-36f339ceeffb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:32.391736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6e4cc-473d-4980-a2e5-36f339ceeffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:32.392056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6e4cc-473d-4980-a2e5-36f339ceeffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:32.392821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6e4cc-473d-4980-a2e5-36f339ceeffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:32.394925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008189-7d6e-41ee-9311-080c7599ffec None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:32.395290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008189-7d6e-41ee-9311-080c7599ffec None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:32.395551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008189-7d6e-41ee-9311-080c7599ffec None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:32.397106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 867/1724] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:32.416171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6e4cc-473d-4980-a2e5-36f339ceeffb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:32.449755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c085-eda3-49d4-9ffb-2ab1707ef127 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:32.450055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c085-eda3-49d4-9ffb-2ab1707ef127 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:32.450346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90c085-eda3-49d4-9ffb-2ab1707ef127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:32.512413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 858/1725] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:32.513371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6e4cc-473d-4980-a2e5-36f339ceeffb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:32.522203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cb90c085-eda3-49d4-9ffb-2ab1707ef127 None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:32.535401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cb90c085-eda3-49d4-9ffb-2ab1707ef127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:32.588460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6e4cc-473d-4980-a2e5-36f339ceeffb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:32.607286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afff448-829a-418b-a918-0f3443b0ae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:32.610742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afff448-829a-418b-a918-0f3443b0ae6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:32.612980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afff448-829a-418b-a918-0f3443b0ae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:32.616478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afff448-829a-418b-a918-0f3443b0ae6a admin admin] PATH_INFO: `/v3/projects/6c668963c9434e29976f6c3c9d2468e4/users/c70af45ceb514d08889df837374e56e2/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:32.668622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afff448-829a-418b-a918-0f3443b0ae6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c668963c9434e29976f6c3c9d2468e4, user_id=c70af45ceb514d08889df837374e56e2, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:32.671534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afff448-829a-418b-a918-0f3443b0ae6a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:32.795145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 859/1726] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:32 2022] PUT /identity/v3/projects/6c668963c9434e29976f6c3c9d2468e4/users/c70af45ceb514d08889df837374e56e2/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:32.796313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afff448-829a-418b-a918-0f3443b0ae6a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:32.907971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 868/1727] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:40:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:33.000720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afff448-829a-418b-a918-0f3443b0ae6a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:33.016889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f89b7-0f50-40c1-bb71-20e627003680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:33.020042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f89b7-0f50-40c1-bb71-20e627003680 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:33.020732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f89b7-0f50-40c1-bb71-20e627003680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:33.021700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f89b7-0f50-40c1-bb71-20e627003680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:33.022731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f89b7-0f50-40c1-bb71-20e627003680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:33.028080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f89b7-0f50-40c1-bb71-20e627003680 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:33.056231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 860/1728] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:33.057780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90c085-eda3-49d4-9ffb-2ab1707ef127 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:33.078817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90c085-eda3-49d4-9ffb-2ab1707ef127 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:33.092739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee12b6-73e0-487f-9b6f-467b4e815701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:33.096039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee12b6-73e0-487f-9b6f-467b4e815701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:33.096326 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee12b6-73e0-487f-9b6f-467b4e815701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:33.103473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee12b6-73e0-487f-9b6f-467b4e815701 admin admin] PATH_INFO: `/v3/projects/6c668963c9434e29976f6c3c9d2468e4/users/c70af45ceb514d08889df837374e56e2/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:33.103473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee12b6-73e0-487f-9b6f-467b4e815701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c668963c9434e29976f6c3c9d2468e4, user_id=c70af45ceb514d08889df837374e56e2, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:33.103473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee12b6-73e0-487f-9b6f-467b4e815701 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:33.191542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 869/1729] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:33 2022] PUT /identity/v3/projects/6c668963c9434e29976f6c3c9d2468e4/users/c70af45ceb514d08889df837374e56e2/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:33.196853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555b76b-0b74-461e-ae7c-b9e3dfb364c4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:33.197562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555b76b-0b74-461e-ae7c-b9e3dfb364c4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:33.198102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555b76b-0b74-461e-ae7c-b9e3dfb364c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:33.238563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0919c8-694a-4ed8-8c20-4987f612aee8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:33.238563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0919c8-694a-4ed8-8c20-4987f612aee8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:33.238563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0919c8-694a-4ed8-8c20-4987f612aee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:33.324611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8f0919c8-694a-4ed8-8c20-4987f612aee8 None None] MFA Rules not processed for user `2ff9f53decbc44ce9166f6c841e8ea02`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:33.326479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8f0919c8-694a-4ed8-8c20-4987f612aee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:33.329874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8555b76b-0b74-461e-ae7c-b9e3dfb364c4 None None] MFA Rules not processed for user `c70af45ceb514d08889df837374e56e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:33.331257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8555b76b-0b74-461e-ae7c-b9e3dfb364c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:33.449599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:33.526672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:33.541124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 870/1730] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:33.667102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 861/1731] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:33.763773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0919c8-694a-4ed8-8c20-4987f612aee8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:33.763773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8f0919c8-694a-4ed8-8c20-4987f612aee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:33.968184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0919c8-694a-4ed8-8c20-4987f612aee8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:33.973655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6adf3-3645-42b8-b480-618d226f5903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:33.974366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6adf3-3645-42b8-b480-618d226f5903 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:33.974794 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6adf3-3645-42b8-b480-618d226f5903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:33.975197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6adf3-3645-42b8-b480-618d226f5903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:33.989481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6adf3-3645-42b8-b480-618d226f5903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:33.992612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6adf3-3645-42b8-b480-618d226f5903 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:34.034142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 871/1732] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:34.971283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530784d3-79ee-4e45-bc1a-31c15b52391f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:34.971764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530784d3-79ee-4e45-bc1a-31c15b52391f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:34.971859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530784d3-79ee-4e45-bc1a-31c15b52391f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:34.973746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 862/1733] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jun 15 00:40:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:34.985979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c73f7-423e-4a5c-8efd-4a92e5740ddd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:34.986512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c73f7-423e-4a5c-8efd-4a92e5740ddd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:34.986512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c73f7-423e-4a5c-8efd-4a92e5740ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:35.080143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2f8c73f7-423e-4a5c-8efd-4a92e5740ddd None None] MFA Rules not processed for user `1eaffae68edd4031ac771310b7d645cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:35.085100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2f8c73f7-423e-4a5c-8efd-4a92e5740ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:35.207209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 872/1734] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:40:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:35.231626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530784d3-79ee-4e45-bc1a-31c15b52391f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:35.267369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530784d3-79ee-4e45-bc1a-31c15b52391f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:35.323145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:35.323145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:35.323145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:35.348030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:35.378472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:35.383527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:35.407552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 863/1735] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:35.682083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:35.746416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:36.287596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c73f7-423e-4a5c-8efd-4a92e5740ddd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:36.308349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c73f7-423e-4a5c-8efd-4a92e5740ddd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:36.319089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1741b55-aa52-4eed-b789-aa9b0b8b2f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:36.320770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741b55-aa52-4eed-b789-aa9b0b8b2f2f service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:36.321367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741b55-aa52-4eed-b789-aa9b0b8b2f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:36.322104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1741b55-aa52-4eed-b789-aa9b0b8b2f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:36.487849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1741b55-aa52-4eed-b789-aa9b0b8b2f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:36.492987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1741b55-aa52-4eed-b789-aa9b0b8b2f2f service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:36.532523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 873/1736] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:36.910639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:36.912707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:37.047204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad673-eb55-4235-b5c3-2e77e4b355f4 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:37.053519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8254f63-9fd0-413f-b93a-1e70eaa29586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:37.054534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8254f63-9fd0-413f-b93a-1e70eaa29586 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:37.055160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8254f63-9fd0-413f-b93a-1e70eaa29586 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:37.055636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8254f63-9fd0-413f-b93a-1e70eaa29586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:37.067284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8254f63-9fd0-413f-b93a-1e70eaa29586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:37.070111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8254f63-9fd0-413f-b93a-1e70eaa29586 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:37.106613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 864/1737] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:40.654670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfd1d-00fe-41f9-92cf-632ca912237b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:40.656488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfd1d-00fe-41f9-92cf-632ca912237b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:40.656488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfd1d-00fe-41f9-92cf-632ca912237b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:40.658173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 874/1738] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:40:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:40.669962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c5f6-d201-4b01-9ce6-240601a7e84d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:40.670489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c5f6-d201-4b01-9ce6-240601a7e84d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:40.670565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c5f6-d201-4b01-9ce6-240601a7e84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:40.699217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8812c5f6-d201-4b01-9ce6-240601a7e84d None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:40.700728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8812c5f6-d201-4b01-9ce6-240601a7e84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:40.730802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 865/1739] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:40:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:40.845936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cfd1d-00fe-41f9-92cf-632ca912237b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:40.848143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d97cfd1d-00fe-41f9-92cf-632ca912237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:40.950684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cfd1d-00fe-41f9-92cf-632ca912237b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:40.974818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:40.975541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:40.975832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:40.978080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:40.989531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:40.993942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:41.014974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 875/1740] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:44.305363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812c5f6-d201-4b01-9ce6-240601a7e84d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:44.317071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812c5f6-d201-4b01-9ce6-240601a7e84d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:44.321303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:44.322096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:44.322453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:44.322851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:44.401373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:44.402944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:44.420887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 866/1741] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:45.191649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:45.194061 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:45.234990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:45.236479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:45.270459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a954-dfe1-438a-ba62-284dd69a30d4 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:45.289411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:45.289601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:45.289601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:45.289601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:45.289601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] PATH_INFO: `/v3/users/18866a01b6e84fcf828c9ef14465537e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:45.289896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18866a01b6e84fcf828c9ef14465537e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:45.289896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:45.316168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309f17-1f53-4bec-a495-9882d567d2de service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:45.323050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:45.323932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:45.324228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:45.324501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] PATH_INFO: `/v3/users/c8d97c1e2c004cb68ac0121b710c0e66` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:45.325693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d97c1e2c004cb68ac0121b710c0e66)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:45.327694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:45.523423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18866a01b6e84fcf828c9ef14465537e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.527094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d97c1e2c004cb68ac0121b710c0e66'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.547839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:45.552385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18866a01b6e84fcf828c9ef14465537e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.635299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d97c1e2c004cb68ac0121b710c0e66'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.652785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d97c1e2c004cb68ac0121b710c0e66'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.653743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d97c1e2c004cb68ac0121b710c0e66'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.662672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-55289d1d-130c-413a-b13c-d7c0c79aa388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d97c1e2c004cb68ac0121b710c0e66'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.670246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 867/1742] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:45 2022] DELETE /identity/v3/users/c8d97c1e2c004cb68ac0121b710c0e66 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:45.675095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db20145-b7c1-46c0-95c5-82d51f360e40 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:45.675457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db20145-b7c1-46c0-95c5-82d51f360e40 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:45.675809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db20145-b7c1-46c0-95c5-82d51f360e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:45.711437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7db20145-b7c1-46c0-95c5-82d51f360e40 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:45.713474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7db20145-b7c1-46c0-95c5-82d51f360e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:45.719547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18866a01b6e84fcf828c9ef14465537e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.720485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18866a01b6e84fcf828c9ef14465537e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.741802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-956c27e5-2520-4279-9b4a-b8140be23503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18866a01b6e84fcf828c9ef14465537e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:45.755330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 876/1743] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:45 2022] DELETE /identity/v3/users/18866a01b6e84fcf828c9ef14465537e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:45.757204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc522e-9ea4-4c3c-a2c7-e0bdc0d87acc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:45.757899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc522e-9ea4-4c3c-a2c7-e0bdc0d87acc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:45.759156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc522e-9ea4-4c3c-a2c7-e0bdc0d87acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:45.787075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-26cc522e-9ea4-4c3c-a2c7-e0bdc0d87acc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:45.789833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-26cc522e-9ea4-4c3c-a2c7-e0bdc0d87acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:45.847123 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 868/1744] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:45.861312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db20145-b7c1-46c0-95c5-82d51f360e40 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:45.863575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7db20145-b7c1-46c0-95c5-82d51f360e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:45.881870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 877/1745] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:45.896095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc522e-9ea4-4c3c-a2c7-e0bdc0d87acc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:45.897754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-26cc522e-9ea4-4c3c-a2c7-e0bdc0d87acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:45.972209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db20145-b7c1-46c0-95c5-82d51f360e40 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:45.983124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:46.019126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc522e-9ea4-4c3c-a2c7-e0bdc0d87acc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:46.028618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:46.029709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:46.030187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:46.032289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:46.035591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:46.036304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:46.036604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:46.037038 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:46.051020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:46.052992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:46.054339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:46.057568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:46.066700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 869/1746] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:46.080009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 878/1747] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:47.354829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:47.356412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:47.370143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b530f5-eb12-4132-b89b-3a6a1454e577 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:47.375885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:47.376926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:47.377410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:47.377881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] PATH_INFO: `/v3/projects/2dc65227e51e4d4ebece29dfdea6f125` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:47.379171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc65227e51e4d4ebece29dfdea6f125)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:47.381393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:47.478961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:47.480656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:47.497583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab047f8c-4035-48a9-a7bc-54798f02df30 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:47.527811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:47.527811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:47.528487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:47.528839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] PATH_INFO: `/v3/projects/2c01519e87f2421aaf886211e2daad71` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:47.557157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c01519e87f2421aaf886211e2daad71)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:47.568062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:47.616765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc65227e51e4d4ebece29dfdea6f125', 'request_id': 'req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.636754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc65227e51e4d4ebece29dfdea6f125', 'request_id': 'req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.652208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc65227e51e4d4ebece29dfdea6f125', 'request_id': 'req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.734448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c01519e87f2421aaf886211e2daad71', 'request_id': 'req-692480a5-f3ee-4256-b557-fb02428e9103'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.748850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] The token cache is being invalidate because project 2dc65227e51e4d4ebece29dfdea6f125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:47.748850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.748850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b2b4fcbe-5f20-4dc3-bedf-b573d466fee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.751506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 870/1748] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:47 2022] DELETE /identity/v3/projects/2dc65227e51e4d4ebece29dfdea6f125 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:47.756474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30e4c-d106-4ddd-873e-e2de0ce3c5a0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:47.757142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30e4c-d106-4ddd-873e-e2de0ce3c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:47.758870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30e4c-d106-4ddd-873e-e2de0ce3c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:47.761887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c01519e87f2421aaf886211e2daad71', 'request_id': 'req-692480a5-f3ee-4256-b557-fb02428e9103'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.786170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c01519e87f2421aaf886211e2daad71', 'request_id': 'req-692480a5-f3ee-4256-b557-fb02428e9103'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.897356 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:47.902442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] The token cache is being invalidate because project 2c01519e87f2421aaf886211e2daad71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:47.902745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.903933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:47.910163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 879/1749] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:47 2022] DELETE /identity/v3/projects/2c01519e87f2421aaf886211e2daad71 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:47.912375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:47.914834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:47.943566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0ee30e4c-d106-4ddd-873e-e2de0ce3c5a0 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:47.944842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0ee30e4c-d106-4ddd-873e-e2de0ce3c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:48.034504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 871/1750] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:48.040114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692480a5-f3ee-4256-b557-fb02428e9103 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:48.042355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16759d-b971-49f0-9c9b-6ef59a83d799 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.042643 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16759d-b971-49f0-9c9b-6ef59a83d799 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.042923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16759d-b971-49f0-9c9b-6ef59a83d799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.046753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:48.047696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.048081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.048364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] PATH_INFO: `/v3/users/e27664b08c2d43388dc8991e9fb77a72` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.049599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27664b08c2d43388dc8991e9fb77a72)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:48.062305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:48.082519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3c16759d-b971-49f0-9c9b-6ef59a83d799 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:48.083757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3c16759d-b971-49f0-9c9b-6ef59a83d799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:48.117582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 872/1751] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:48.118515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16759d-b971-49f0-9c9b-6ef59a83d799 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:48.131146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16759d-b971-49f0-9c9b-6ef59a83d799 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:48.146222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:48.148659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.148962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.149245 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.149991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:48.152428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:48.154414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:48.176863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 873/1752] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:48.180802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:48.200392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002f369-c748-45b0-be6e-dc65eb84bf87 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:48.216300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e1ec5-b626-424b-9154-cc5e5de65232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:48.216300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1ec5-b626-424b-9154-cc5e5de65232 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.216300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1ec5-b626-424b-9154-cc5e5de65232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.216300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e1ec5-b626-424b-9154-cc5e5de65232 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.216632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e1ec5-b626-424b-9154-cc5e5de65232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:48.217771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e1ec5-b626-424b-9154-cc5e5de65232 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:48.326699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27664b08c2d43388dc8991e9fb77a72'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:48.335993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:48.349200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 874/1753] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:48 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:48.353399 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e1ec5-b626-424b-9154-cc5e5de65232 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:48.361686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27664b08c2d43388dc8991e9fb77a72'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:48.430049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e1ec5-b626-424b-9154-cc5e5de65232 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:48.435299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:48.442532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.443208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.450991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.450991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:48.450991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:48.502130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27664b08c2d43388dc8991e9fb77a72'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:48.503330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27664b08c2d43388dc8991e9fb77a72'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:48.518769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b5e0893-078c-4410-b3e5-24f81cacdb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27664b08c2d43388dc8991e9fb77a72'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:48.529024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 880/1754] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:47 2022] DELETE /identity/v3/users/e27664b08c2d43388dc8991e9fb77a72 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:48.531941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d710-8ab6-46b7-8fb0-59218c80ba70 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.531941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d710-8ab6-46b7-8fb0-59218c80ba70 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.532286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2d710-8ab6-46b7-8fb0-59218c80ba70 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.534590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 881/1755] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:40:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:48.540969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754ee35-b97f-439d-ba6d-b6db57b46a24 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.541387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754ee35-b97f-439d-ba6d-b6db57b46a24 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.547770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754ee35-b97f-439d-ba6d-b6db57b46a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.561675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 875/1756] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:48 2022] POST /identity/v3/users => generated 303 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:48.566419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:48.570200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:48.589181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5754ee35-b97f-439d-ba6d-b6db57b46a24 None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:48.593757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5754ee35-b97f-439d-ba6d-b6db57b46a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:48.595055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526314c-e34f-41f0-aa97-33e731d1eea3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:48.692368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 882/1757] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:40:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:48.705111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d19a0-5190-4302-9e62-52586350aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:48.706510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d19a0-5190-4302-9e62-52586350aa04 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.706510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d19a0-5190-4302-9e62-52586350aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.706691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d19a0-5190-4302-9e62-52586350aa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.707695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d19a0-5190-4302-9e62-52586350aa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:48.709923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d19a0-5190-4302-9e62-52586350aa04 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:48.725096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 876/1758] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:48.728053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754ee35-b97f-439d-ba6d-b6db57b46a24 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:48.729197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d19a0-5190-4302-9e62-52586350aa04 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:48.729847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5754ee35-b97f-439d-ba6d-b6db57b46a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:48.740984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d19a0-5190-4302-9e62-52586350aa04 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:48.747449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9d389-a58c-4682-93ca-f14f68010073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:48.748175 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9d389-a58c-4682-93ca-f14f68010073 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.749851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9d389-a58c-4682-93ca-f14f68010073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.750651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9d389-a58c-4682-93ca-f14f68010073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.751608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9d389-a58c-4682-93ca-f14f68010073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:48.753223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754ee35-b97f-439d-ba6d-b6db57b46a24 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:48.753585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9d389-a58c-4682-93ca-f14f68010073 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:48.762350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3819a-e4af-4b35-a374-f0d1fcd64851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:48.763442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3819a-e4af-4b35-a374-f0d1fcd64851 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.764090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3819a-e4af-4b35-a374-f0d1fcd64851 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.764564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3819a-e4af-4b35-a374-f0d1fcd64851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.769689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 877/1759] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:48.773553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9d389-a58c-4682-93ca-f14f68010073 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:48.777837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3819a-e4af-4b35-a374-f0d1fcd64851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:48.779746 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3819a-e4af-4b35-a374-f0d1fcd64851 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:48.788412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9d389-a58c-4682-93ca-f14f68010073 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:48.794950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 883/1760] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:48.796158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:48.797664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.797951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.798232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] PATH_INFO: `/v3/projects/3ddb81660ad54d60bb15c2aa092c0a1c/users/08137085517048c4a19f21de166484a7/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.820020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddb81660ad54d60bb15c2aa092c0a1c, user_id=08137085517048c4a19f21de166484a7, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:48.824143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:48.919890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 878/1761] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:48 2022] PUT /identity/v3/projects/3ddb81660ad54d60bb15c2aa092c0a1c/users/08137085517048c4a19f21de166484a7/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:48.924975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566890-0158-4533-91d1-76b10212b482 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:48.925264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566890-0158-4533-91d1-76b10212b482 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:48.925544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566890-0158-4533-91d1-76b10212b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:48.955643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b2566890-0158-4533-91d1-76b10212b482 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:48.956938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b2566890-0158-4533-91d1-76b10212b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:49.095541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 884/1762] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:49.123067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:49.123067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:49.257463 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b1a48-1632-42a1-bb5e-c949dc7d9887 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:49.263724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:49.264664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:49.266079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:49.266628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:49.283103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:49.284660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:49.295044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 879/1763] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:49.716279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566890-0158-4533-91d1-76b10212b482 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:49.726077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b2566890-0158-4533-91d1-76b10212b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:49.751354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2566890-0158-4533-91d1-76b10212b482 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:49.774470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:49.775705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:49.776163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:49.776447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] PATH_INFO: `/v3/projects/75aee4f8b1e54d3da43effff671c5c10` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:49.777755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=75aee4f8b1e54d3da43effff671c5c10)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:49.781733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:49.784341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:49.788520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:49.810871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943822-77d4-45d2-905f-6e2bfcd3b984 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:49.820850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:49.820850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:49.820850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:49.820850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] PATH_INFO: `/v3/users/2305847fbea84ced8f2c1a92ace955df` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:49.821236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2305847fbea84ced8f2c1a92ace955df)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:49.822337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:49.990692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75aee4f8b1e54d3da43effff671c5c10', 'request_id': 'req-2aceb03e-9d50-4cff-ba44-82abae35e92b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.000178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75aee4f8b1e54d3da43effff671c5c10', 'request_id': 'req-2aceb03e-9d50-4cff-ba44-82abae35e92b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.010210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75aee4f8b1e54d3da43effff671c5c10', 'request_id': 'req-2aceb03e-9d50-4cff-ba44-82abae35e92b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.077427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2305847fbea84ced8f2c1a92ace955df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.092784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] The token cache is being invalidate because project 75aee4f8b1e54d3da43effff671c5c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:50.097785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.097785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2aceb03e-9d50-4cff-ba44-82abae35e92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.110480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 885/1764] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:49 2022] DELETE /identity/v3/projects/75aee4f8b1e54d3da43effff671c5c10 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:50.115399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240011a1-f96f-464e-b125-0837100d2616 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.116564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240011a1-f96f-464e-b125-0837100d2616 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.116740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240011a1-f96f-464e-b125-0837100d2616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.137042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-240011a1-f96f-464e-b125-0837100d2616 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:50.138387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-240011a1-f96f-464e-b125-0837100d2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:50.177061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2305847fbea84ced8f2c1a92ace955df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.215023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2305847fbea84ced8f2c1a92ace955df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.216540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2305847fbea84ced8f2c1a92ace955df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.237468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f608215-5cd5-4efd-938b-d660b2f53fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2305847fbea84ced8f2c1a92ace955df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:50.243653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 886/1765] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:50.247834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 880/1766] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:49 2022] DELETE /identity/v3/users/2305847fbea84ced8f2c1a92ace955df => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:50.258455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952396c-6cbc-45d9-b1d4-cb979b1c4b19 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.258575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2bd0-2b15-4010-abd5-0e5d387f09c5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.258770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952396c-6cbc-45d9-b1d4-cb979b1c4b19 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.258853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2bd0-2b15-4010-abd5-0e5d387f09c5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.259078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952396c-6cbc-45d9-b1d4-cb979b1c4b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.259200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b2bd0-2b15-4010-abd5-0e5d387f09c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.280390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a952396c-6cbc-45d9-b1d4-cb979b1c4b19 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:50.281616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a952396c-6cbc-45d9-b1d4-cb979b1c4b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:50.303577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a20b2bd0-2b15-4010-abd5-0e5d387f09c5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:50.305002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a20b2bd0-2b15-4010-abd5-0e5d387f09c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:50.394839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 881/1767] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:50.397305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 887/1768] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:50.399128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b2bd0-2b15-4010-abd5-0e5d387f09c5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:50.408959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952396c-6cbc-45d9-b1d4-cb979b1c4b19 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:50.410574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a952396c-6cbc-45d9-b1d4-cb979b1c4b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:50.413307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b2bd0-2b15-4010-abd5-0e5d387f09c5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:50.423606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:50.424748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.425137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.425519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.426806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:50.427219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:50.428980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:50.446593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 882/1769] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:50.451472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:50.462759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a06a8-0066-4a6d-8b12-097c3b874b30 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:50.467897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d3b30-f9c1-4445-ac71-93a1892b9769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:50.468740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3b30-f9c1-4445-ac71-93a1892b9769 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.469025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3b30-f9c1-4445-ac71-93a1892b9769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.469297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3b30-f9c1-4445-ac71-93a1892b9769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.470203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d3b30-f9c1-4445-ac71-93a1892b9769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:50.472338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d3b30-f9c1-4445-ac71-93a1892b9769 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:50.478516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952396c-6cbc-45d9-b1d4-cb979b1c4b19 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:50.483969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb26c5-0a8e-4d78-9159-da243a0ff000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:50.485093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb26c5-0a8e-4d78-9159-da243a0ff000 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.485474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb26c5-0a8e-4d78-9159-da243a0ff000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.485862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb26c5-0a8e-4d78-9159-da243a0ff000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.496754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb26c5-0a8e-4d78-9159-da243a0ff000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:50.498199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb26c5-0a8e-4d78-9159-da243a0ff000 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:50.511418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 888/1770] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:50.616622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 883/1771] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:50 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:50.622273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb26c5-0a8e-4d78-9159-da243a0ff000 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:50.650465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb26c5-0a8e-4d78-9159-da243a0ff000 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:50.720486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efae5f9-4cae-41d2-b607-f91818e8989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:50.721156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efae5f9-4cae-41d2-b607-f91818e8989d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.721437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efae5f9-4cae-41d2-b607-f91818e8989d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.721711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efae5f9-4cae-41d2-b607-f91818e8989d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.722419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efae5f9-4cae-41d2-b607-f91818e8989d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:50.724421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efae5f9-4cae-41d2-b607-f91818e8989d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:50.822437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 889/1772] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:50 2022] POST /identity/v3/users => generated 282 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:50.826585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d3b30-f9c1-4445-ac71-93a1892b9769 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:50.838418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d3b30-f9c1-4445-ac71-93a1892b9769 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:50.844294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cedcb9-f44e-4476-b8c3-d4cadb9e301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:50.847342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cedcb9-f44e-4476-b8c3-d4cadb9e301b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.847342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cedcb9-f44e-4476-b8c3-d4cadb9e301b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.847342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cedcb9-f44e-4476-b8c3-d4cadb9e301b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.847342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cedcb9-f44e-4476-b8c3-d4cadb9e301b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:50.847774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cedcb9-f44e-4476-b8c3-d4cadb9e301b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:50.863124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 884/1773] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:50.864091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efae5f9-4cae-41d2-b607-f91818e8989d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:50.876665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efae5f9-4cae-41d2-b607-f91818e8989d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:50.881530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:50.882201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.882485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.882767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.883493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:50.885361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:50.898802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 890/1774] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:50.902968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cedcb9-f44e-4476-b8c3-d4cadb9e301b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:50.914174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cedcb9-f44e-4476-b8c3-d4cadb9e301b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:50.918956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8296e-2929-4bd2-afc9-2251030d04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:50.919831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8296e-2929-4bd2-afc9-2251030d04e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:50.920185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8296e-2929-4bd2-afc9-2251030d04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:50.920699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8296e-2929-4bd2-afc9-2251030d04e6 admin admin] PATH_INFO: `/v3/projects/7634e947b7d94ae9b7df4831a9d95352/users/9aff125b0f9847ef913565b302fc672d/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:50.943878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8296e-2929-4bd2-afc9-2251030d04e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7634e947b7d94ae9b7df4831a9d95352, user_id=9aff125b0f9847ef913565b302fc672d, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:50.946673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8296e-2929-4bd2-afc9-2251030d04e6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:51.013276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:51.015372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:51.031372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf9709-96bd-4978-8b1d-b340140181dc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:51.035275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:51.036262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.036545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.036822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] PATH_INFO: `/v3/projects/f198e5d0f4ca4f3c8acb99df0cf020d7` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.038245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f198e5d0f4ca4f3c8acb99df0cf020d7)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:51.041266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:51.058886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 885/1775] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:50 2022] PUT /identity/v3/projects/7634e947b7d94ae9b7df4831a9d95352/users/9aff125b0f9847ef913565b302fc672d/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:51.069957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720273-e654-45b8-8322-20fe1ce40a5d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.070257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720273-e654-45b8-8322-20fe1ce40a5d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.070732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a720273-e654-45b8-8322-20fe1ce40a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.102358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3a720273-e654-45b8-8322-20fe1ce40a5d None None] MFA Rules not processed for user `9aff125b0f9847ef913565b302fc672d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:51.103820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a720273-e654-45b8-8322-20fe1ce40a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:51.167718 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f198e5d0f4ca4f3c8acb99df0cf020d7', 'request_id': 'req-b4d925bc-933c-4211-b6ba-863e2c965331'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.175189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f198e5d0f4ca4f3c8acb99df0cf020d7', 'request_id': 'req-b4d925bc-933c-4211-b6ba-863e2c965331'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.184381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f198e5d0f4ca4f3c8acb99df0cf020d7', 'request_id': 'req-b4d925bc-933c-4211-b6ba-863e2c965331'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.191683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 886/1776] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:51.195744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a720273-e654-45b8-8322-20fe1ce40a5d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:51.272490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a720273-e654-45b8-8322-20fe1ce40a5d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:51.310811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:51.320410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] The token cache is being invalidate because project f198e5d0f4ca4f3c8acb99df0cf020d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:51.320977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.321997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.323933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 891/1777] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:51 2022] DELETE /identity/v3/projects/f198e5d0f4ca4f3c8acb99df0cf020d7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:51.328987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:51.330371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:51.333470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:51.334120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.334399 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.334674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.335363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:51.337334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:51.349178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d925bc-933c-4211-b6ba-863e2c965331 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:51.349516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:51.350415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.350651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.350921 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] PATH_INFO: `/v3/users/9cd95b59ad70479281e377864a1d183d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.352165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd95b59ad70479281e377864a1d183d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:51.356846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:51.436338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 887/1778] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:51 2022] POST /identity/v3/projects => generated 363 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:40:51.440276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:51.442005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:51.505325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf1b66-2759-4189-9654-718994fde1c8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:51.510146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947952e1-ad5d-401f-8e7f-954eea32bc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:51.511074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947952e1-ad5d-401f-8e7f-954eea32bc9f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.511358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947952e1-ad5d-401f-8e7f-954eea32bc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.511643 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947952e1-ad5d-401f-8e7f-954eea32bc9f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.513971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947952e1-ad5d-401f-8e7f-954eea32bc9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:51.514496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947952e1-ad5d-401f-8e7f-954eea32bc9f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:51.604368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd95b59ad70479281e377864a1d183d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.611549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd95b59ad70479281e377864a1d183d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.644469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 888/1779] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:51 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:40:51.644469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ed9d4-6c03-4685-ba45-116c225113e8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.644469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ed9d4-6c03-4685-ba45-116c225113e8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.644469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ed9d4-6c03-4685-ba45-116c225113e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.670134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b14ed9d4-6c03-4685-ba45-116c225113e8 None None] MFA Rules not processed for user `08137085517048c4a19f21de166484a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:51.671365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b14ed9d4-6c03-4685-ba45-116c225113e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:51.685929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd95b59ad70479281e377864a1d183d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.687132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd95b59ad70479281e377864a1d183d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.699699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd95b59ad70479281e377864a1d183d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:51.706357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 892/1780] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:51 2022] DELETE /identity/v3/users/9cd95b59ad70479281e377864a1d183d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:51.709328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:51.710799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:51.734350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:51.752298 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 889/1781] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:51.756810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ed9d4-6c03-4685-ba45-116c225113e8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:51.758767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b14ed9d4-6c03-4685-ba45-116c225113e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:51.776374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ed9d4-6c03-4685-ba45-116c225113e8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:51.793792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c79fc1-9d1c-4e60-bca7-45d4d5cc9443 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:51.800085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a375f-82be-46a6-b41c-cb8d7963d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:51.800728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a375f-82be-46a6-b41c-cb8d7963d13a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.801182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a375f-82be-46a6-b41c-cb8d7963d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.801464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a375f-82be-46a6-b41c-cb8d7963d13a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.802201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a375f-82be-46a6-b41c-cb8d7963d13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:51.803870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a375f-82be-46a6-b41c-cb8d7963d13a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:51.814474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 893/1782] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:51.818605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a375f-82be-46a6-b41c-cb8d7963d13a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:51.829777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a375f-82be-46a6-b41c-cb8d7963d13a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:51.834484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec17c7-73d6-42ec-ab8d-cadb4ca23e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:51.834914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1103fc4-f8b6-4fea-85a7-704c5066014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:51.835361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec17c7-73d6-42ec-ab8d-cadb4ca23e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.835579 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1103fc4-f8b6-4fea-85a7-704c5066014e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:51.835684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec17c7-73d6-42ec-ab8d-cadb4ca23e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.835864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1103fc4-f8b6-4fea-85a7-704c5066014e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:51.835989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec17c7-73d6-42ec-ab8d-cadb4ca23e2b admin admin] PATH_INFO: `/v3/projects/02b4ff1565954245a12cb59d80acf647/users/230d5b4c76994f43bc6a3ac91371443b/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.836213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1103fc4-f8b6-4fea-85a7-704c5066014e admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:51.836891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1103fc4-f8b6-4fea-85a7-704c5066014e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:51.838825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1103fc4-f8b6-4fea-85a7-704c5066014e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:51.850382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec17c7-73d6-42ec-ab8d-cadb4ca23e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b4ff1565954245a12cb59d80acf647, user_id=230d5b4c76994f43bc6a3ac91371443b, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:51.853118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec17c7-73d6-42ec-ab8d-cadb4ca23e2b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:51.958323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 894/1783] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:51 2022] PUT /identity/v3/projects/02b4ff1565954245a12cb59d80acf647/users/230d5b4c76994f43bc6a3ac91371443b/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:51.962269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec17c7-73d6-42ec-ab8d-cadb4ca23e2b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:51.964413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 890/1784] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:51 2022] POST /identity/v3/projects => generated 403 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:51.965301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1103fc4-f8b6-4fea-85a7-704c5066014e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.045268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec17c7-73d6-42ec-ab8d-cadb4ca23e2b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.051671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982db05-2acb-4483-9eb5-7f5a1f3936a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.052994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982db05-2acb-4483-9eb5-7f5a1f3936a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.053425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982db05-2acb-4483-9eb5-7f5a1f3936a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.053879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982db05-2acb-4483-9eb5-7f5a1f3936a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.054258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1103fc4-f8b6-4fea-85a7-704c5066014e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.054946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982db05-2acb-4483-9eb5-7f5a1f3936a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.056970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982db05-2acb-4483-9eb5-7f5a1f3936a9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.061568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.063817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.064126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.064411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.065288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.067055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.076233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 895/1785] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:52.080371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982db05-2acb-4483-9eb5-7f5a1f3936a9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.090141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982db05-2acb-4483-9eb5-7f5a1f3936a9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.094708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe5bce-de3d-4da1-9297-7b644a5be91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.095556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5bce-de3d-4da1-9297-7b644a5be91f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.095839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5bce-de3d-4da1-9297-7b644a5be91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.096259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5bce-de3d-4da1-9297-7b644a5be91f admin admin] PATH_INFO: `/v3/projects/02b4ff1565954245a12cb59d80acf647/users/230d5b4c76994f43bc6a3ac91371443b/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.098216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe5bce-de3d-4da1-9297-7b644a5be91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b4ff1565954245a12cb59d80acf647, user_id=230d5b4c76994f43bc6a3ac91371443b, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.100872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe5bce-de3d-4da1-9297-7b644a5be91f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.111099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 896/1786] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:52 2022] PUT /identity/v3/projects/02b4ff1565954245a12cb59d80acf647/users/230d5b4c76994f43bc6a3ac91371443b/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:52.121761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049eded-23e6-4a1c-a249-60630e580fb6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.122052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049eded-23e6-4a1c-a249-60630e580fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.122332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049eded-23e6-4a1c-a249-60630e580fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.148821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2049eded-23e6-4a1c-a249-60630e580fb6 None None] MFA Rules not processed for user `230d5b4c76994f43bc6a3ac91371443b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:52.150004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2049eded-23e6-4a1c-a249-60630e580fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:52.174446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 891/1787] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:51 2022] POST /identity/v3/users => generated 308 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:52.174446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.179018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:52.189800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba72b15-1692-450d-9690-b6f7893b6741 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.227306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 897/1788] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:52.228212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049eded-23e6-4a1c-a249-60630e580fb6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.252005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.252963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.253243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.253515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] PATH_INFO: `/v3/projects/7efecc2f834c4d7ba1018a2f8a6a620f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.254748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7efecc2f834c4d7ba1018a2f8a6a620f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.257215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.301668 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049eded-23e6-4a1c-a249-60630e580fb6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.304439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.305354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.305733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.306081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.306889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.308613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.318799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 898/1789] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:52.319626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.323297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:52.387044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1064a-2dbb-43ff-898e-514537e3d030 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.397268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efecc2f834c4d7ba1018a2f8a6a620f', 'request_id': 'req-0a284cdb-e5a8-485d-91b8-816e41bbcee9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.410839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efecc2f834c4d7ba1018a2f8a6a620f', 'request_id': 'req-0a284cdb-e5a8-485d-91b8-816e41bbcee9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.420788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efecc2f834c4d7ba1018a2f8a6a620f', 'request_id': 'req-0a284cdb-e5a8-485d-91b8-816e41bbcee9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.459179 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e323-7e72-4659-94f6-d9093b68a554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.459862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e323-7e72-4659-94f6-d9093b68a554 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.460209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e323-7e72-4659-94f6-d9093b68a554 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.460538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e323-7e72-4659-94f6-d9093b68a554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.538348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6e323-7e72-4659-94f6-d9093b68a554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.538348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6e323-7e72-4659-94f6-d9093b68a554 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.542830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 899/1790] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:52.543704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e323-7e72-4659-94f6-d9093b68a554 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.548977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] The token cache is being invalidate because project 7efecc2f834c4d7ba1018a2f8a6a620f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:52.550029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.551183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.553464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 892/1791] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:52 2022] DELETE /identity/v3/projects/7efecc2f834c4d7ba1018a2f8a6a620f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:52.557358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.560044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:52.619928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e323-7e72-4659-94f6-d9093b68a554 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.624980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.625871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.626151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.626427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] PATH_INFO: `/v3/projects/e07b756448c4481aa7f9d502915ce459/users/878569a0a20249878c837c62e498149a/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.636655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a284cdb-e5a8-485d-91b8-816e41bbcee9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.641844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.642102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07b756448c4481aa7f9d502915ce459, user_id=878569a0a20249878c837c62e498149a, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.642756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.643042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.643315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] PATH_INFO: `/v3/users/c70af45ceb514d08889df837374e56e2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.644540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70af45ceb514d08889df837374e56e2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.644814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.646432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.744072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 900/1792] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:52 2022] PUT /identity/v3/projects/e07b756448c4481aa7f9d502915ce459/users/878569a0a20249878c837c62e498149a/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:52.747846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.749533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:52.814150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d59c0-d220-4a95-8aea-1ce23049212c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.818989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273a271-1db4-48b9-85e9-189342c79594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.819657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273a271-1db4-48b9-85e9-189342c79594 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.819992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273a271-1db4-48b9-85e9-189342c79594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.820273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273a271-1db4-48b9-85e9-189342c79594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.821007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273a271-1db4-48b9-85e9-189342c79594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.823003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273a271-1db4-48b9-85e9-189342c79594 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.834400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 901/1793] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:40:52.839467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273a271-1db4-48b9-85e9-189342c79594 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.851804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273a271-1db4-48b9-85e9-189342c79594 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.856402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.857262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.857545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.857818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] PATH_INFO: `/v3/projects/e07b756448c4481aa7f9d502915ce459/users/878569a0a20249878c837c62e498149a/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.859748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07b756448c4481aa7f9d502915ce459, user_id=878569a0a20249878c837c62e498149a, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:52.862418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:52.872268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 902/1794] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:52 2022] PUT /identity/v3/projects/e07b756448c4481aa7f9d502915ce459/users/878569a0a20249878c837c62e498149a/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:52.873408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:52.874631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:52.906440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70af45ceb514d08889df837374e56e2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.931619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc33ec6-dce5-4bc6-9c11-6b6474d87a53 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:52.935256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:52.935894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:52.936211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:52.936482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:52.938320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:52.983579 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70af45ceb514d08889df837374e56e2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.996344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70af45ceb514d08889df837374e56e2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.997094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70af45ceb514d08889df837374e56e2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:52.997980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:53.000358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:53.005025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-338ea60f-ad66-4a88-8d48-4e29b6ee15f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70af45ceb514d08889df837374e56e2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.010794 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 903/1795] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:53.012362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 893/1796] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:52 2022] DELETE /identity/v3/users/c70af45ceb514d08889df837374e56e2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:53.793444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:53.882649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eed1e-cf0c-4861-ae14-7bf9a3da2b7b service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:53.944453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:53.945321 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:53.945605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:53.945882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] PATH_INFO: `/v3/projects/6c668963c9434e29976f6c3c9d2468e4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:53.947069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c668963c9434e29976f6c3c9d2468e4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:53.949033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.059472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c668963c9434e29976f6c3c9d2468e4', 'request_id': 'req-d7c1a542-f474-491a-8687-75e39b749381'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:54.065482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c668963c9434e29976f6c3c9d2468e4', 'request_id': 'req-d7c1a542-f474-491a-8687-75e39b749381'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:54.071642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c668963c9434e29976f6c3c9d2468e4', 'request_id': 'req-d7c1a542-f474-491a-8687-75e39b749381'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:54.154075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] The token cache is being invalidate because project 6c668963c9434e29976f6c3c9d2468e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:54.154362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:54.154998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d7c1a542-f474-491a-8687-75e39b749381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:54.156583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 904/1797] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:53 2022] DELETE /identity/v3/projects/6c668963c9434e29976f6c3c9d2468e4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:54.163420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907c8f-0d6e-4bc0-ab13-aa57730f1f49 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.163893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907c8f-0d6e-4bc0-ab13-aa57730f1f49 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.164027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0907c8f-0d6e-4bc0-ab13-aa57730f1f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.181657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c0907c8f-0d6e-4bc0-ab13-aa57730f1f49 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:54.182852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c0907c8f-0d6e-4bc0-ab13-aa57730f1f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:54.194656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:54.245962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 894/1798] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:40:54.255316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbf1b6-daff-4f80-9da6-98d5f2f6b659 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.255499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbf1b6-daff-4f80-9da6-98d5f2f6b659 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.255777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbf1b6-daff-4f80-9da6-98d5f2f6b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.276856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8ddbf1b6-daff-4f80-9da6-98d5f2f6b659 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:54.278200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8ddbf1b6-daff-4f80-9da6-98d5f2f6b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:54.288796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 905/1799] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:54.292966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0907c8f-0d6e-4bc0-ab13-aa57730f1f49 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.304239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0907c8f-0d6e-4bc0-ab13-aa57730f1f49 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.315655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.316941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.321978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.322124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef69f-c863-4187-8e34-4cf77408db8d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.322217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.322300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef69f-c863-4187-8e34-4cf77408db8d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.322300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef69f-c863-4187-8e34-4cf77408db8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.322445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:54.322445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.323645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.339087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 895/1800] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:40:54.344265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.353333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6818a-4818-40dd-b32b-aaae6194f3e7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.359656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06ce94-70a1-4a8e-b905-b786f8b1e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.360505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ce94-70a1-4a8e-b905-b786f8b1e256 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.360789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ce94-70a1-4a8e-b905-b786f8b1e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.361064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06ce94-70a1-4a8e-b905-b786f8b1e256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.361764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06ce94-70a1-4a8e-b905-b786f8b1e256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.363859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06ce94-70a1-4a8e-b905-b786f8b1e256 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.364648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2b9ef69f-c863-4187-8e34-4cf77408db8d None None] MFA Rules not processed for user `878569a0a20249878c837c62e498149a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:54.366004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2b9ef69f-c863-4187-8e34-4cf77408db8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:54.450273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 906/1801] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:54.475170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 896/1802] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:40:54.479311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ef69f-c863-4187-8e34-4cf77408db8d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.490301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ef69f-c863-4187-8e34-4cf77408db8d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.548956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de518bc-335b-4e1c-9cb0-c8b2a4a8b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.549646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de518bc-335b-4e1c-9cb0-c8b2a4a8b38f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.549946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de518bc-335b-4e1c-9cb0-c8b2a4a8b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.550234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de518bc-335b-4e1c-9cb0-c8b2a4a8b38f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.550933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de518bc-335b-4e1c-9cb0-c8b2a4a8b38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.552901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de518bc-335b-4e1c-9cb0-c8b2a4a8b38f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.646171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 907/1803] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:54.650187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06ce94-70a1-4a8e-b905-b786f8b1e256 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.660665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06ce94-70a1-4a8e-b905-b786f8b1e256 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.665480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f80050-3ea4-414e-8a72-803ca5b03597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.666159 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80050-3ea4-414e-8a72-803ca5b03597 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.666440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80050-3ea4-414e-8a72-803ca5b03597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.666936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80050-3ea4-414e-8a72-803ca5b03597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.667691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f80050-3ea4-414e-8a72-803ca5b03597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.669308 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f80050-3ea4-414e-8a72-803ca5b03597 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.679639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 897/1804] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:54.687139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de518bc-335b-4e1c-9cb0-c8b2a4a8b38f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.697044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de518bc-335b-4e1c-9cb0-c8b2a4a8b38f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.701661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39036cd4-9b8e-40f0-b2bf-91eb950740b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.702309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036cd4-9b8e-40f0-b2bf-91eb950740b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.702592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036cd4-9b8e-40f0-b2bf-91eb950740b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.702871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036cd4-9b8e-40f0-b2bf-91eb950740b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.703620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39036cd4-9b8e-40f0-b2bf-91eb950740b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.705238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39036cd4-9b8e-40f0-b2bf-91eb950740b6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.715492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 908/1805] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:54.716960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:54.724827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f80050-3ea4-414e-8a72-803ca5b03597 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.730023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f80050-3ea4-414e-8a72-803ca5b03597 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.738847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.739827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.740219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.740556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] PATH_INFO: `/v3/projects/e47b81532c9449d2b9787da4f8d18532/users/43c272b0d7044717839e3285209b6f57/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.757981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47b81532c9449d2b9787da4f8d18532, user_id=43c272b0d7044717839e3285209b6f57, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.761005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.835045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 898/1806] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:54 2022] PUT /identity/v3/projects/e47b81532c9449d2b9787da4f8d18532/users/43c272b0d7044717839e3285209b6f57/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:54.840415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457339-58cf-4a6b-b0ae-e194b77df0ba None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.840803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457339-58cf-4a6b-b0ae-e194b77df0ba None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.841153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457339-58cf-4a6b-b0ae-e194b77df0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.860140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1c457339-58cf-4a6b-b0ae-e194b77df0ba None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:54.861513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c457339-58cf-4a6b-b0ae-e194b77df0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:54.938078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 909/1807] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:54.965140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.966921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:55.029416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fc51-a406-4455-8c8b-f442ce1bb7a0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:55.033075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6bcd1-29dc-4cde-ba81-8fb4933063bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:55.033722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bcd1-29dc-4cde-ba81-8fb4933063bb service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:55.034001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bcd1-29dc-4cde-ba81-8fb4933063bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:55.034273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bcd1-29dc-4cde-ba81-8fb4933063bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:55.043809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6bcd1-29dc-4cde-ba81-8fb4933063bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:55.045333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6bcd1-29dc-4cde-ba81-8fb4933063bb service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:55.055849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 899/1808] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:55.199460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd539811-224d-49bb-ae14-486ac013b443 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:55.199755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd539811-224d-49bb-ae14-486ac013b443 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:55.200203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd539811-224d-49bb-ae14-486ac013b443 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:55.201773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 910/1809] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:55.208597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f5a9-a8b7-4cb2-a2ac-72cb9a6f0dfd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:55.209080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f5a9-a8b7-4cb2-a2ac-72cb9a6f0dfd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:55.209172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f5a9-a8b7-4cb2-a2ac-72cb9a6f0dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:55.228342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cea2f5a9-a8b7-4cb2-a2ac-72cb9a6f0dfd None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:55.229571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cea2f5a9-a8b7-4cb2-a2ac-72cb9a6f0dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:55.302837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 900/1810] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:40:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:55.314325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3d6e-8ebf-4a41-b0a8-94097a212727 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:55.314653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3d6e-8ebf-4a41-b0a8-94097a212727 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:55.314978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3d6e-8ebf-4a41-b0a8-94097a212727 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:55.316376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 911/1811] 10.222.0.17 () {54 vars in 960 bytes} [Wed Jun 15 00:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:40:55.321560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf79e-f02f-4523-97c7-f9ae5476cb7a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:55.321849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf79e-f02f-4523-97c7-f9ae5476cb7a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:55.322274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf79e-f02f-4523-97c7-f9ae5476cb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:55.339695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b5ddf79e-f02f-4523-97c7-f9ae5476cb7a None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:55.340923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b5ddf79e-f02f-4523-97c7-f9ae5476cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:55.350486 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 901/1812] 10.222.0.17 () {58 vars in 1057 bytes} [Wed Jun 15 00:40:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:55.357750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3d6e-8ebf-4a41-b0a8-94097a212727 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:55.372078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3d6e-8ebf-4a41-b0a8-94097a212727 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:55.377203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c7e75-75b9-4ad7-9408-a3093f014ff7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:55.377845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c7e75-75b9-4ad7-9408-a3093f014ff7 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:55.378122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c7e75-75b9-4ad7-9408-a3093f014ff7 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:55.378395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c7e75-75b9-4ad7-9408-a3093f014ff7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:55.387486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c7e75-75b9-4ad7-9408-a3093f014ff7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:55.389223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c7e75-75b9-4ad7-9408-a3093f014ff7 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:55.399982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 912/1813] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:55.966429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:56.232556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddf79e-f02f-4523-97c7-f9ae5476cb7a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:56.235240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b5ddf79e-f02f-4523-97c7-f9ae5476cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:56.259320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddf79e-f02f-4523-97c7-f9ae5476cb7a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:56.265575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:56.266719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:56.267200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:56.267652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] PATH_INFO: `/v3/users/08137085517048c4a19f21de166484a7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:56.269327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08137085517048c4a19f21de166484a7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:56.271527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:56.305391 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:56.531154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08137085517048c4a19f21de166484a7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:56.611935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08137085517048c4a19f21de166484a7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:56.632929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08137085517048c4a19f21de166484a7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:56.634169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08137085517048c4a19f21de166484a7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:56.641309 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08137085517048c4a19f21de166484a7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:56.651010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 902/1814] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:56 2022] DELETE /identity/v3/users/08137085517048c4a19f21de166484a7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:56.713891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815aab-fbe2-40f8-8d35-e5740a2f7532 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:56.714518 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815aab-fbe2-40f8-8d35-e5740a2f7532 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:56.715215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8815aab-fbe2-40f8-8d35-e5740a2f7532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:56.788975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c8815aab-fbe2-40f8-8d35-e5740a2f7532 None None] MFA Rules not processed for user `43c272b0d7044717839e3285209b6f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:56.790922 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c8815aab-fbe2-40f8-8d35-e5740a2f7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:56.915458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 913/1815] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:56.919793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:56.921473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:56.957087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815aab-fbe2-40f8-8d35-e5740a2f7532 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:56.958936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c8815aab-fbe2-40f8-8d35-e5740a2f7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:57.006715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c6ac6-98f6-4f2e-b128-2f90b2186610 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:57.015110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe431b-33a9-434b-8b58-3590516d56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:57.016327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe431b-33a9-434b-8b58-3590516d56d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:57.016545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe431b-33a9-434b-8b58-3590516d56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:57.017014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe431b-33a9-434b-8b58-3590516d56d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:57.018352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe431b-33a9-434b-8b58-3590516d56d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:57.020949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe431b-33a9-434b-8b58-3590516d56d2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:57.036044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8815aab-fbe2-40f8-8d35-e5740a2f7532 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:57.040690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:57.041543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:57.041825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:57.042100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] PATH_INFO: `/v3/projects/3ddb81660ad54d60bb15c2aa092c0a1c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:57.043269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddb81660ad54d60bb15c2aa092c0a1c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:57.046710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:57.143048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 903/1816] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:56 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:57.144047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe431b-33a9-434b-8b58-3590516d56d2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:57.153824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddb81660ad54d60bb15c2aa092c0a1c', 'request_id': 'req-fb017d18-d593-46d2-9c4c-79c424030390'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.161067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddb81660ad54d60bb15c2aa092c0a1c', 'request_id': 'req-fb017d18-d593-46d2-9c4c-79c424030390'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.168116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddb81660ad54d60bb15c2aa092c0a1c', 'request_id': 'req-fb017d18-d593-46d2-9c4c-79c424030390'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.216032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe431b-33a9-434b-8b58-3590516d56d2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:57.227188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:57.233845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:57.233845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:57.233845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:57.233845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:57.235059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:57.237286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:57.262604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] The token cache is being invalidate because project 3ddb81660ad54d60bb15c2aa092c0a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:57.262604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.262604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.262604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 914/1817] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:56 2022] DELETE /identity/v3/projects/3ddb81660ad54d60bb15c2aa092c0a1c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:57.264478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:57.265830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:57.321700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 904/1818] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:57 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:57.325911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:57.330446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:57.347381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb017d18-d593-46d2-9c4c-79c424030390 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:57.357150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:57.360840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:57.361698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:57.361874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b7f9-d38d-4ada-9e94-ebc6dcf03686 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:57.362325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] PATH_INFO: `/v3/users/878569a0a20249878c837c62e498149a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:57.364858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878569a0a20249878c837c62e498149a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:57.367567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:57.372393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789dd1-da6e-442a-87ce-03db51647b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:57.373202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789dd1-da6e-442a-87ce-03db51647b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:57.373719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789dd1-da6e-442a-87ce-03db51647b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:57.374960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789dd1-da6e-442a-87ce-03db51647b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:57.375972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789dd1-da6e-442a-87ce-03db51647b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:57.378055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789dd1-da6e-442a-87ce-03db51647b44 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:57.395685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 905/1819] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:57.400082 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789dd1-da6e-442a-87ce-03db51647b44 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:57.417639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789dd1-da6e-442a-87ce-03db51647b44 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:57.425467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c85ad-fce5-498b-936d-c713a3449abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:57.425467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c85ad-fce5-498b-936d-c713a3449abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:57.425467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c85ad-fce5-498b-936d-c713a3449abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:57.425834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c85ad-fce5-498b-936d-c713a3449abd admin admin] PATH_INFO: `/v3/projects/933adf224fed4a6b8621a4a1bb4d008f/users/80e8f4a691904c04975c2bb64769d522/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:57.458479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c85ad-fce5-498b-936d-c713a3449abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=933adf224fed4a6b8621a4a1bb4d008f, user_id=80e8f4a691904c04975c2bb64769d522, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:57.465417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c85ad-fce5-498b-936d-c713a3449abd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:57.645274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 906/1820] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:57 2022] PUT /identity/v3/projects/933adf224fed4a6b8621a4a1bb4d008f/users/80e8f4a691904c04975c2bb64769d522/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:57.646177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c85ad-fce5-498b-936d-c713a3449abd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:57.665925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878569a0a20249878c837c62e498149a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.682237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878569a0a20249878c837c62e498149a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.748000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c85ad-fce5-498b-936d-c713a3449abd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:57.753560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30270efb-4218-460e-9e90-6c17a1327bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:57.754654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270efb-4218-460e-9e90-6c17a1327bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:57.754934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270efb-4218-460e-9e90-6c17a1327bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:57.755204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270efb-4218-460e-9e90-6c17a1327bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:57.755941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30270efb-4218-460e-9e90-6c17a1327bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:57.757596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30270efb-4218-460e-9e90-6c17a1327bdf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:57.783738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 907/1821] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:57.785057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30270efb-4218-460e-9e90-6c17a1327bdf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:57.789406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878569a0a20249878c837c62e498149a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.790185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878569a0a20249878c837c62e498149a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.803625 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878569a0a20249878c837c62e498149a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:57.806213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30270efb-4218-460e-9e90-6c17a1327bdf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:57.810169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 915/1822] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:57 2022] DELETE /identity/v3/users/878569a0a20249878c837c62e498149a => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:57.818680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f67c5b-6fd7-4630-a424-b2724500097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:57.827597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67c5b-6fd7-4630-a424-b2724500097a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:57.827896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67c5b-6fd7-4630-a424-b2724500097a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:57.828196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f67c5b-6fd7-4630-a424-b2724500097a admin admin] PATH_INFO: `/v3/projects/933adf224fed4a6b8621a4a1bb4d008f/users/80e8f4a691904c04975c2bb64769d522/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:57.830734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f67c5b-6fd7-4630-a424-b2724500097a admin admin] RBAC: Authorizing `identity:create_grant(project_id=933adf224fed4a6b8621a4a1bb4d008f, user_id=80e8f4a691904c04975c2bb64769d522, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:57.833544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f67c5b-6fd7-4630-a424-b2724500097a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:57.845960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 908/1823] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:57 2022] PUT /identity/v3/projects/933adf224fed4a6b8621a4a1bb4d008f/users/80e8f4a691904c04975c2bb64769d522/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:58.064114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:58.065632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:58.173651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddc51-d54a-4f73-b279-5220accde6b2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:58.230012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:58.270551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:58.270768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:58.271024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:58.271437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] PATH_INFO: `/v3/projects/e07b756448c4481aa7f9d502915ce459` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:58.272741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07b756448c4481aa7f9d502915ce459)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:58.274698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:58.393902 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07b756448c4481aa7f9d502915ce459', 'request_id': 'req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:58.399133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07b756448c4481aa7f9d502915ce459', 'request_id': 'req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:58.405715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07b756448c4481aa7f9d502915ce459', 'request_id': 'req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:58.514809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] The token cache is being invalidate because project e07b756448c4481aa7f9d502915ce459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:58.515125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:58.515762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-023ce7b9-11f4-4db2-bf68-b55ef2c270a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:58.517410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 916/1824] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:58 2022] DELETE /identity/v3/projects/e07b756448c4481aa7f9d502915ce459 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:58.522371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62be4a0-37b3-4e31-aa2f-31a50459e285 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:58.522860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62be4a0-37b3-4e31-aa2f-31a50459e285 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:58.522979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62be4a0-37b3-4e31-aa2f-31a50459e285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:58.543116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b62be4a0-37b3-4e31-aa2f-31a50459e285 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:58.544471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b62be4a0-37b3-4e31-aa2f-31a50459e285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:58.605420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 909/1825] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:58.613087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505adb-c75c-4819-852b-f3a8f1a4667b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:58.613377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505adb-c75c-4819-852b-f3a8f1a4667b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:58.613650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9505adb-c75c-4819-852b-f3a8f1a4667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:58.632900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9505adb-c75c-4819-852b-f3a8f1a4667b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:58.634508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9505adb-c75c-4819-852b-f3a8f1a4667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:58.644000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 917/1826] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:58.648454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62be4a0-37b3-4e31-aa2f-31a50459e285 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:58.659853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62be4a0-37b3-4e31-aa2f-31a50459e285 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:58.668127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:58.668275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:58.668475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:58.668850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:58.669590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:58.669903 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:58.671519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:58.687565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 910/1827] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:58.692489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9505adb-c75c-4819-852b-f3a8f1a4667b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:58.702522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9505adb-c75c-4819-852b-f3a8f1a4667b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:58.707210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6abbe-492b-4ca2-a77c-6d190e703421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:58.707864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6abbe-492b-4ca2-a77c-6d190e703421 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:58.708181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6abbe-492b-4ca2-a77c-6d190e703421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:58.708459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6abbe-492b-4ca2-a77c-6d190e703421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:58.709150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6abbe-492b-4ca2-a77c-6d190e703421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:58.711120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6abbe-492b-4ca2-a77c-6d190e703421 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:58.725674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:58.837526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 918/1828] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:58 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:58.841880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:58.861478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adbee8-4d3b-450f-9c55-e960553fc492 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:58.974059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09675a02-1e2f-4cf9-aaab-2e51184fccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:58.974721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675a02-1e2f-4cf9-aaab-2e51184fccb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:58.975052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675a02-1e2f-4cf9-aaab-2e51184fccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:58.975341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675a02-1e2f-4cf9-aaab-2e51184fccb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:58.976132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09675a02-1e2f-4cf9-aaab-2e51184fccb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:58.980875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09675a02-1e2f-4cf9-aaab-2e51184fccb6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:59.153152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 911/1829] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:58 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:59.159289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6abbe-492b-4ca2-a77c-6d190e703421 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:59.171819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6abbe-492b-4ca2-a77c-6d190e703421 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:59.179191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ed146-935f-4b5c-8a23-060e53f68ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:59.180208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ed146-935f-4b5c-8a23-060e53f68ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.180699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ed146-935f-4b5c-8a23-060e53f68ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.181190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ed146-935f-4b5c-8a23-060e53f68ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.182231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ed146-935f-4b5c-8a23-060e53f68ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:59.184647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ed146-935f-4b5c-8a23-060e53f68ac6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:59.206149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 919/1830] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:40:59.209278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09675a02-1e2f-4cf9-aaab-2e51184fccb6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:59.221112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09675a02-1e2f-4cf9-aaab-2e51184fccb6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:59.227150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236362e-665d-46e8-8fef-48b91afe9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:59.228236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236362e-665d-46e8-8fef-48b91afe9dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.228681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236362e-665d-46e8-8fef-48b91afe9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.228962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236362e-665d-46e8-8fef-48b91afe9dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.229833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236362e-665d-46e8-8fef-48b91afe9dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:59.231498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236362e-665d-46e8-8fef-48b91afe9dcb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:59.242530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 912/1831] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:59.246758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ed146-935f-4b5c-8a23-060e53f68ac6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:59.257763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ed146-935f-4b5c-8a23-060e53f68ac6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:59.263219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3301a-cbfd-482c-8a2a-91efd7190260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:59.264158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3301a-cbfd-482c-8a2a-91efd7190260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.265001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3301a-cbfd-482c-8a2a-91efd7190260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.265280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3301a-cbfd-482c-8a2a-91efd7190260 admin admin] PATH_INFO: `/v3/projects/3c5e9af1e12141dd9e739ca6e39f75d8/users/21ca399ed21a40f6b2d9832fa3a3733e/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.282626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3301a-cbfd-482c-8a2a-91efd7190260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5e9af1e12141dd9e739ca6e39f75d8, user_id=21ca399ed21a40f6b2d9832fa3a3733e, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:59.285397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3301a-cbfd-482c-8a2a-91efd7190260 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:59.389825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 920/1832] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:59 2022] PUT /identity/v3/projects/3c5e9af1e12141dd9e739ca6e39f75d8/users/21ca399ed21a40f6b2d9832fa3a3733e/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:59.401350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172d87-aec9-42cb-9a93-abb093b6fb01 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.401715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172d87-aec9-42cb-9a93-abb093b6fb01 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.402664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b172d87-aec9-42cb-9a93-abb093b6fb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.433465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3b172d87-aec9-42cb-9a93-abb093b6fb01 None None] MFA Rules not processed for user `21ca399ed21a40f6b2d9832fa3a3733e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:59.434806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b172d87-aec9-42cb-9a93-abb093b6fb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:59.502749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 913/1833] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:59.507250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3301a-cbfd-482c-8a2a-91efd7190260 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:59.540722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c7ebc-b0c8-462f-b982-574ced5c553b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.541547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c7ebc-b0c8-462f-b982-574ced5c553b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.541743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c7ebc-b0c8-462f-b982-574ced5c553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.577274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-655c7ebc-b0c8-462f-b982-574ced5c553b None None] MFA Rules not processed for user `80e8f4a691904c04975c2bb64769d522`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:59.578638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-655c7ebc-b0c8-462f-b982-574ced5c553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:59.585662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3301a-cbfd-482c-8a2a-91efd7190260 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:59.593456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7088-68e1-4ad4-93ae-bb9ddc4e2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:59.594527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7088-68e1-4ad4-93ae-bb9ddc4e2750 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.594812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7088-68e1-4ad4-93ae-bb9ddc4e2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.599693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7088-68e1-4ad4-93ae-bb9ddc4e2750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.599693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c7088-68e1-4ad4-93ae-bb9ddc4e2750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:59.599693 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c7088-68e1-4ad4-93ae-bb9ddc4e2750 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:59.666704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 914/1834] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:59.681046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c7ebc-b0c8-462f-b982-574ced5c553b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:59.682851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-655c7ebc-b0c8-462f-b982-574ced5c553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:59.697275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 921/1835] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:59 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:59.702399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7088-68e1-4ad4-93ae-bb9ddc4e2750 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:59.800520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7088-68e1-4ad4-93ae-bb9ddc4e2750 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:59.806974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab0ce-1e09-4789-aec6-2a74e8eebdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:59.807882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab0ce-1e09-4789-aec6-2a74e8eebdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.808300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab0ce-1e09-4789-aec6-2a74e8eebdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.808541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c7ebc-b0c8-462f-b982-574ced5c553b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:59.808648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab0ce-1e09-4789-aec6-2a74e8eebdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.809504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab0ce-1e09-4789-aec6-2a74e8eebdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:59.811708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab0ce-1e09-4789-aec6-2a74e8eebdb8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:59.859927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:59.860631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.860905 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.861227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.863145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:59.898669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 922/1836] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:59 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:59.928761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:59.930492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:59.934184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab0ce-1e09-4789-aec6-2a74e8eebdb8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:59.941383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 915/1837] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:59.957225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab0ce-1e09-4789-aec6-2a74e8eebdb8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:59.962574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31939df-5062-41db-97e5-94df80f4c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:00.044510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31939df-5062-41db-97e5-94df80f4c4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:00.044510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31939df-5062-41db-97e5-94df80f4c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:00.044510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31939df-5062-41db-97e5-94df80f4c4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:00.044510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31939df-5062-41db-97e5-94df80f4c4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:00.044510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31939df-5062-41db-97e5-94df80f4c4bf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:00.044510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 923/1838] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:00.046496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:00.046496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a33c-58fc-4768-9608-74285657a635 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:00.046496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4d2cf-3ad5-46f7-962a-547e9f15491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:00.046496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4d2cf-3ad5-46f7-962a-547e9f15491d admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:00.046827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4d2cf-3ad5-46f7-962a-547e9f15491d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:00.046827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4d2cf-3ad5-46f7-962a-547e9f15491d admin admin] PATH_INFO: `/v3/projects/902f714530b943b19d3e9309a3dbfbaa/users/d0c7d6c8072c4cb5bdff62009128791f/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:00.054349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4d2cf-3ad5-46f7-962a-547e9f15491d admin admin] RBAC: Authorizing `identity:create_grant(project_id=902f714530b943b19d3e9309a3dbfbaa, user_id=d0c7d6c8072c4cb5bdff62009128791f, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:00.057036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4d2cf-3ad5-46f7-962a-547e9f15491d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:00.439868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 916/1839] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:00 2022] PUT /identity/v3/projects/902f714530b943b19d3e9309a3dbfbaa/users/d0c7d6c8072c4cb5bdff62009128791f/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:00.443826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31939df-5062-41db-97e5-94df80f4c4bf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:00.454551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31939df-5062-41db-97e5-94df80f4c4bf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:00.534594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958d844-d8a9-47d7-9826-cd022becef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:00.535332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d844-d8a9-47d7-9826-cd022becef98 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:00.535757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d844-d8a9-47d7-9826-cd022becef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:00.536074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958d844-d8a9-47d7-9826-cd022becef98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:00.536840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d844-d8a9-47d7-9826-cd022becef98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:00.538500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958d844-d8a9-47d7-9826-cd022becef98 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:00.549324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 924/1840] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:00.553503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4d2cf-3ad5-46f7-962a-547e9f15491d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:00.564990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4d2cf-3ad5-46f7-962a-547e9f15491d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:00.569985 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:00.571008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:00.571508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:00.572088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] PATH_INFO: `/v3/projects/902f714530b943b19d3e9309a3dbfbaa/users/d0c7d6c8072c4cb5bdff62009128791f/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:00.574413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902f714530b943b19d3e9309a3dbfbaa, user_id=d0c7d6c8072c4cb5bdff62009128791f, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:00.578065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:00.588804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 917/1841] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:00 2022] PUT /identity/v3/projects/902f714530b943b19d3e9309a3dbfbaa/users/d0c7d6c8072c4cb5bdff62009128791f/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:00.599147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967639c1-856e-4806-95db-9cb5ad27f5ed None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:00.602223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967639c1-856e-4806-95db-9cb5ad27f5ed None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:00.602223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967639c1-856e-4806-95db-9cb5ad27f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:00.626058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-967639c1-856e-4806-95db-9cb5ad27f5ed None None] MFA Rules not processed for user `d0c7d6c8072c4cb5bdff62009128791f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:00.627334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-967639c1-856e-4806-95db-9cb5ad27f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:00.698278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 925/1842] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:00.709771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:00.711481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:00.768344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806878b-79a9-4091-bd07-7c22a0a7adf6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:00.772043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0bcb4-7a5f-48b2-92be-cd091abdd1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:00.774533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bcb4-7a5f-48b2-92be-cd091abdd1fa service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:00.774533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bcb4-7a5f-48b2-92be-cd091abdd1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:00.774533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0bcb4-7a5f-48b2-92be-cd091abdd1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:00.782009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0bcb4-7a5f-48b2-92be-cd091abdd1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:00.783413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0bcb4-7a5f-48b2-92be-cd091abdd1fa service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:00.792657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 918/1843] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:00.846048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:01.184128 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:01.411042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967639c1-856e-4806-95db-9cb5ad27f5ed None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:01.476444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967639c1-856e-4806-95db-9cb5ad27f5ed None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:01.481062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:01.481935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:01.482215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:01.482490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] PATH_INFO: `/v3/users/21ca399ed21a40f6b2d9832fa3a3733e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:01.484401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ca399ed21a40f6b2d9832fa3a3733e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:01.486323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:01.710648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ca399ed21a40f6b2d9832fa3a3733e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:01.718230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ca399ed21a40f6b2d9832fa3a3733e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:01.782450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ca399ed21a40f6b2d9832fa3a3733e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:01.783065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ca399ed21a40f6b2d9832fa3a3733e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:01.795136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ca399ed21a40f6b2d9832fa3a3733e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:01.801033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 926/1844] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:01 2022] DELETE /identity/v3/users/21ca399ed21a40f6b2d9832fa3a3733e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:01.805712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdeaa-34af-48c2-ba39-c7a71b46b75e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:01.806200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdeaa-34af-48c2-ba39-c7a71b46b75e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:01.806295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdeaa-34af-48c2-ba39-c7a71b46b75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:01.823011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-48fcdeaa-34af-48c2-ba39-c7a71b46b75e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:01.824215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-48fcdeaa-34af-48c2-ba39-c7a71b46b75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:01.881866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 919/1845] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:01.892412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:01.893847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:01.898184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:01.951098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e528e2c-7d4f-4633-b601-626dcf568e7d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:01.955247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4f8fd-bbc4-4c42-8145-a53ed7cb03e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:01.955880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4f8fd-bbc4-4c42-8145-a53ed7cb03e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:01.956186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4f8fd-bbc4-4c42-8145-a53ed7cb03e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:01.956457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4f8fd-bbc4-4c42-8145-a53ed7cb03e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:01.965470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4f8fd-bbc4-4c42-8145-a53ed7cb03e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:01.966885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4f8fd-bbc4-4c42-8145-a53ed7cb03e4 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:01.976675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 927/1846] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:02.385198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcdeaa-34af-48c2-ba39-c7a71b46b75e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:02.387114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-48fcdeaa-34af-48c2-ba39-c7a71b46b75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:02.398969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcdeaa-34af-48c2-ba39-c7a71b46b75e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:02.404429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:02.405318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:02.405598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:02.405923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] PATH_INFO: `/v3/projects/3c5e9af1e12141dd9e739ca6e39f75d8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:02.407088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5e9af1e12141dd9e739ca6e39f75d8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:02.409081 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:02.565022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5e9af1e12141dd9e739ca6e39f75d8', 'request_id': 'req-4db6365b-b240-4d87-ac8a-e512060aeb7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:02.571211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:02.572487 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5e9af1e12141dd9e739ca6e39f75d8', 'request_id': 'req-4db6365b-b240-4d87-ac8a-e512060aeb7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:02.578815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5e9af1e12141dd9e739ca6e39f75d8', 'request_id': 'req-4db6365b-b240-4d87-ac8a-e512060aeb7b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:02.672147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] The token cache is being invalidate because project 3c5e9af1e12141dd9e739ca6e39f75d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:02.672547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:02.673254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:02.674888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 920/1847] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:02 2022] DELETE /identity/v3/projects/3c5e9af1e12141dd9e739ca6e39f75d8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:02.678914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4f8fd-bbc4-4c42-8145-a53ed7cb03e4 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:02.688797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4f8fd-bbc4-4c42-8145-a53ed7cb03e4 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:02.753167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:02.754049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:02.754355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:02.754653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] PATH_INFO: `/v3/users/d0c7d6c8072c4cb5bdff62009128791f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:02.755837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c7d6c8072c4cb5bdff62009128791f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:02.757819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:02.857381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:02.974133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c7d6c8072c4cb5bdff62009128791f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:02.981267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c7d6c8072c4cb5bdff62009128791f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.061109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c7d6c8072c4cb5bdff62009128791f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.062288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c7d6c8072c4cb5bdff62009128791f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.075256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c7d6c8072c4cb5bdff62009128791f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.081698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 928/1848] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:02 2022] DELETE /identity/v3/users/d0c7d6c8072c4cb5bdff62009128791f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:03.090103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:03.091501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:03.151826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6365b-b240-4d87-ac8a-e512060aeb7b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:03.199631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085542e-b98f-473e-8ca7-acdd316a6c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:03.200306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085542e-b98f-473e-8ca7-acdd316a6c48 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.200585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085542e-b98f-473e-8ca7-acdd316a6c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.200854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085542e-b98f-473e-8ca7-acdd316a6c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.203653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c085542e-b98f-473e-8ca7-acdd316a6c48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:03.268148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085542e-b98f-473e-8ca7-acdd316a6c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:03.271043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085542e-b98f-473e-8ca7-acdd316a6c48 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:03.282802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 921/1849] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:03.585468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:03.587534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:03.690904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e71df9-a5d9-47d6-9a90-559c5dd286e0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:03.696551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:03.697420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.697699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.697981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] PATH_INFO: `/v3/projects/902f714530b943b19d3e9309a3dbfbaa` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.699231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] RBAC: Authorizing `identity:delete_project(project_id=902f714530b943b19d3e9309a3dbfbaa)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:03.701151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:03.803004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902f714530b943b19d3e9309a3dbfbaa', 'request_id': 'req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.808448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902f714530b943b19d3e9309a3dbfbaa', 'request_id': 'req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.815182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902f714530b943b19d3e9309a3dbfbaa', 'request_id': 'req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.919672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] The token cache is being invalidate because project 902f714530b943b19d3e9309a3dbfbaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:03.919672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.919672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1d9b0837-4fba-4195-aaaa-1d03ad8e68af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:03.926185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 929/1850] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:03 2022] DELETE /identity/v3/projects/902f714530b943b19d3e9309a3dbfbaa => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:03.927369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6eed2-4496-4553-b467-859733a4f525 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.927655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6eed2-4496-4553-b467-859733a4f525 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.928103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6eed2-4496-4553-b467-859733a4f525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.971997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c7b6eed2-4496-4553-b467-859733a4f525 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:03.974526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c7b6eed2-4496-4553-b467-859733a4f525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:04.092582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 922/1851] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:04.100329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123130d4-0294-4c58-ad1f-c1866eaea30b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:04.102946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123130d4-0294-4c58-ad1f-c1866eaea30b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:04.102946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123130d4-0294-4c58-ad1f-c1866eaea30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:04.124577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-123130d4-0294-4c58-ad1f-c1866eaea30b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:04.126009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-123130d4-0294-4c58-ad1f-c1866eaea30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:04.140465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 930/1852] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:04.141961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6eed2-4496-4553-b467-859733a4f525 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:04.143891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:04.154135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6eed2-4496-4553-b467-859733a4f525 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:04.160897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:04.161576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:04.162001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:04.162441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:04.163172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:04.163889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:04.165502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:04.183514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 923/1853] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:04.187755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123130d4-0294-4c58-ad1f-c1866eaea30b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:04.200331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123130d4-0294-4c58-ad1f-c1866eaea30b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:04.206278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d209b8-a3c0-4caf-a33d-edf0894bf9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:04.206950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d209b8-a3c0-4caf-a33d-edf0894bf9aa admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:04.207395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d209b8-a3c0-4caf-a33d-edf0894bf9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:04.207710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d209b8-a3c0-4caf-a33d-edf0894bf9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:04.208428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d209b8-a3c0-4caf-a33d-edf0894bf9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:04.210514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d209b8-a3c0-4caf-a33d-edf0894bf9aa admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:04.312131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 931/1854] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:04 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:04.316450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:04.328444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65054918-24c4-4919-96b3-3675ee16c198 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:04.396540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76dc37-362c-4202-a329-f535fe3fa053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:04.397222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dc37-362c-4202-a329-f535fe3fa053 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:04.397559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dc37-362c-4202-a329-f535fe3fa053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:04.397836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76dc37-362c-4202-a329-f535fe3fa053 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:04.398847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76dc37-362c-4202-a329-f535fe3fa053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:04.401564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76dc37-362c-4202-a329-f535fe3fa053 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:04.537846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 924/1855] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:04 2022] POST /identity/v3/users => generated 281 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:04.541881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d209b8-a3c0-4caf-a33d-edf0894bf9aa admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:04.552780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d209b8-a3c0-4caf-a33d-edf0894bf9aa admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:04.557591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab9b7-7b0c-4456-912d-4783625dba0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:04.558256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab9b7-7b0c-4456-912d-4783625dba0a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:04.558543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab9b7-7b0c-4456-912d-4783625dba0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:04.558820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbab9b7-7b0c-4456-912d-4783625dba0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:04.559574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab9b7-7b0c-4456-912d-4783625dba0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:04.561739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbab9b7-7b0c-4456-912d-4783625dba0a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:04.571789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 932/1856] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:04.575933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76dc37-362c-4202-a329-f535fe3fa053 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:04.583825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:04.591026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76dc37-362c-4202-a329-f535fe3fa053 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:04.597321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39540c8-3162-43ca-b0c3-34bd5c979279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:04.598071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39540c8-3162-43ca-b0c3-34bd5c979279 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:04.598422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39540c8-3162-43ca-b0c3-34bd5c979279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:04.598788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39540c8-3162-43ca-b0c3-34bd5c979279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:04.599587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39540c8-3162-43ca-b0c3-34bd5c979279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:04.601276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39540c8-3162-43ca-b0c3-34bd5c979279 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:04.614350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 925/1857] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:04.618624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab9b7-7b0c-4456-912d-4783625dba0a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:04.629075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbab9b7-7b0c-4456-912d-4783625dba0a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:04.633842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:04.634717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:04.635067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:04.635363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] PATH_INFO: `/v3/projects/6552ee8ccdee43339bb4d73469cde1b6/users/52f22a24c9894e22942739b11b52ab9b/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:04.650218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6552ee8ccdee43339bb4d73469cde1b6, user_id=52f22a24c9894e22942739b11b52ab9b, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:04.652904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:04.783768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 933/1858] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:04 2022] PUT /identity/v3/projects/6552ee8ccdee43339bb4d73469cde1b6/users/52f22a24c9894e22942739b11b52ab9b/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:04.796281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c224292-6837-4772-b342-6039f8c5f76f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:04.796689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c224292-6837-4772-b342-6039f8c5f76f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:04.797085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c224292-6837-4772-b342-6039f8c5f76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:04.827076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4c224292-6837-4772-b342-6039f8c5f76f None None] MFA Rules not processed for user `52f22a24c9894e22942739b11b52ab9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:04.828410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4c224292-6837-4772-b342-6039f8c5f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:04.907588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 926/1859] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:04.939262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:04.941158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:04.996891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73edd-5cf9-48db-8212-b9c8f8534afe admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:05.001237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a198ed-7385-4ad0-af99-6d4f82ee1814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:05.001975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a198ed-7385-4ad0-af99-6d4f82ee1814 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:05.002261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a198ed-7385-4ad0-af99-6d4f82ee1814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:05.002541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a198ed-7385-4ad0-af99-6d4f82ee1814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:05.011238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a198ed-7385-4ad0-af99-6d4f82ee1814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:05.012689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a198ed-7385-4ad0-af99-6d4f82ee1814 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:05.022134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 934/1860] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:05.036608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c224292-6837-4772-b342-6039f8c5f76f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:05.108503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c224292-6837-4772-b342-6039f8c5f76f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:05.113310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:05.114188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:05.114521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:05.114796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] PATH_INFO: `/v3/users/52f22a24c9894e22942739b11b52ab9b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:05.116009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f22a24c9894e22942739b11b52ab9b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:05.117979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:05.325763 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f22a24c9894e22942739b11b52ab9b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:05.406909 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f22a24c9894e22942739b11b52ab9b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:05.432125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f22a24c9894e22942739b11b52ab9b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:05.432125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f22a24c9894e22942739b11b52ab9b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:05.437213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f22a24c9894e22942739b11b52ab9b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:05.443667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 927/1861] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:05 2022] DELETE /identity/v3/users/52f22a24c9894e22942739b11b52ab9b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:05.448178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250809-7fb4-44bd-89c5-d2c7db1d5d2e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:05.448475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250809-7fb4-44bd-89c5-d2c7db1d5d2e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:05.448760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250809-7fb4-44bd-89c5-d2c7db1d5d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:05.466603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-68250809-7fb4-44bd-89c5-d2c7db1d5d2e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:05.468442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-68250809-7fb4-44bd-89c5-d2c7db1d5d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:05.534318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 935/1862] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:05.546911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:05.548456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:05.628062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772096e-fe6a-496e-96b4-93beb312b626 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:05.633338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65157f75-4a6a-4064-bb9b-8424023187fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:05.634032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65157f75-4a6a-4064-bb9b-8424023187fe service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:05.634318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65157f75-4a6a-4064-bb9b-8424023187fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:05.634599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65157f75-4a6a-4064-bb9b-8424023187fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:05.647124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65157f75-4a6a-4064-bb9b-8424023187fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:05.649262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65157f75-4a6a-4064-bb9b-8424023187fe service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:05.676318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 928/1863] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:06.110389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250809-7fb4-44bd-89c5-d2c7db1d5d2e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:06.111932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-68250809-7fb4-44bd-89c5-d2c7db1d5d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:06.127206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250809-7fb4-44bd-89c5-d2c7db1d5d2e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:06.132711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:06.133742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:06.134197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:06.134486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] PATH_INFO: `/v3/projects/6552ee8ccdee43339bb4d73469cde1b6` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:06.136048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6552ee8ccdee43339bb4d73469cde1b6)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:06.138092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:06.181142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:06.428194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6552ee8ccdee43339bb4d73469cde1b6', 'request_id': 'req-e128553e-df31-4986-826f-8e15d28854e0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:06.434512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6552ee8ccdee43339bb4d73469cde1b6', 'request_id': 'req-e128553e-df31-4986-826f-8e15d28854e0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:06.441956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6552ee8ccdee43339bb4d73469cde1b6', 'request_id': 'req-e128553e-df31-4986-826f-8e15d28854e0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:06.523587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:06.565934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] The token cache is being invalidate because project 6552ee8ccdee43339bb4d73469cde1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:06.566181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:06.567059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e128553e-df31-4986-826f-8e15d28854e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:06.568954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 936/1864] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:06 2022] DELETE /identity/v3/projects/6552ee8ccdee43339bb4d73469cde1b6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:06.573801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5ac3-a54a-485f-be41-e7ce19158408 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:06.574303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5ac3-a54a-485f-be41-e7ce19158408 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:06.574581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5ac3-a54a-485f-be41-e7ce19158408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:06.593866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a31e5ac3-a54a-485f-be41-e7ce19158408 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:06.595156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a31e5ac3-a54a-485f-be41-e7ce19158408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:06.655466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 929/1865] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:06.663216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d011-5d99-4433-8b2d-155f7fbaab0e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:06.663729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d011-5d99-4433-8b2d-155f7fbaab0e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:06.664043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d011-5d99-4433-8b2d-155f7fbaab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:06.685552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7f41d011-5d99-4433-8b2d-155f7fbaab0e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:06.686844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7f41d011-5d99-4433-8b2d-155f7fbaab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:06.715561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 937/1866] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:06.716480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e5ac3-a54a-485f-be41-e7ce19158408 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:06.729577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e5ac3-a54a-485f-be41-e7ce19158408 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:06.743364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:06.744908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:06.745334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:06.745620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:06.746412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:06.746752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:06.748599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:06.765456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 930/1867] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:06.770301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d011-5d99-4433-8b2d-155f7fbaab0e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:06.783716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d011-5d99-4433-8b2d-155f7fbaab0e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:06.792721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804716-598a-4047-a289-d7a2d37c492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:06.793879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804716-598a-4047-a289-d7a2d37c492e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:06.795991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804716-598a-4047-a289-d7a2d37c492e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:06.795991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804716-598a-4047-a289-d7a2d37c492e admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:06.795991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804716-598a-4047-a289-d7a2d37c492e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:06.798024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804716-598a-4047-a289-d7a2d37c492e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:06.904000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 938/1868] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:06 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:06.906265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:06.917772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64eeb2-26c3-4e61-b674-9bd9f8e10a38 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:06.982926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6ac96-e2aa-4481-8e69-7bfe946e061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:06.983601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ac96-e2aa-4481-8e69-7bfe946e061b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:06.983883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ac96-e2aa-4481-8e69-7bfe946e061b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:06.984187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6ac96-e2aa-4481-8e69-7bfe946e061b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:06.984875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6ac96-e2aa-4481-8e69-7bfe946e061b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:06.986788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6ac96-e2aa-4481-8e69-7bfe946e061b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:07.068199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 931/1869] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:06 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:07.072101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804716-598a-4047-a289-d7a2d37c492e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:07.084091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804716-598a-4047-a289-d7a2d37c492e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:07.088742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838ea44-f1d8-483d-9209-fb2dfb19bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:07.089639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ea44-f1d8-483d-9209-fb2dfb19bdfe admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.090095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ea44-f1d8-483d-9209-fb2dfb19bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.093279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ea44-f1d8-483d-9209-fb2dfb19bdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.093279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838ea44-f1d8-483d-9209-fb2dfb19bdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:07.094165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838ea44-f1d8-483d-9209-fb2dfb19bdfe admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:07.104870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 939/1870] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:07.109177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6ac96-e2aa-4481-8e69-7bfe946e061b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:07.119301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6ac96-e2aa-4481-8e69-7bfe946e061b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:07.124177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda754f-8f1a-45e3-abf2-511a7c026032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:07.124840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda754f-8f1a-45e3-abf2-511a7c026032 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.125122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda754f-8f1a-45e3-abf2-511a7c026032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.125401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda754f-8f1a-45e3-abf2-511a7c026032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.126123 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda754f-8f1a-45e3-abf2-511a7c026032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:07.127750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda754f-8f1a-45e3-abf2-511a7c026032 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:07.139583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 932/1871] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:07.143681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838ea44-f1d8-483d-9209-fb2dfb19bdfe admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:07.153919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838ea44-f1d8-483d-9209-fb2dfb19bdfe admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:07.158601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5940dd-7f2a-4fed-a244-ac1ea726c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:07.159478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5940dd-7f2a-4fed-a244-ac1ea726c0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.159751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5940dd-7f2a-4fed-a244-ac1ea726c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.160114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5940dd-7f2a-4fed-a244-ac1ea726c0a2 admin admin] PATH_INFO: `/v3/projects/e8440ab48ec543fbb49c08cd25c9ca81/users/820bb862103e4a13bd103fe02612d12d/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.177368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5940dd-7f2a-4fed-a244-ac1ea726c0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8440ab48ec543fbb49c08cd25c9ca81, user_id=820bb862103e4a13bd103fe02612d12d, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:07.180196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5940dd-7f2a-4fed-a244-ac1ea726c0a2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:07.296168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 940/1872] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:07 2022] PUT /identity/v3/projects/e8440ab48ec543fbb49c08cd25c9ca81/users/820bb862103e4a13bd103fe02612d12d/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:07.307329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d344b-837a-4599-b8ea-14fa37c02c31 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.307786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d344b-837a-4599-b8ea-14fa37c02c31 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.307924 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d344b-837a-4599-b8ea-14fa37c02c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.340342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2b5d344b-837a-4599-b8ea-14fa37c02c31 None None] MFA Rules not processed for user `820bb862103e4a13bd103fe02612d12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:07.341705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2b5d344b-837a-4599-b8ea-14fa37c02c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:07.425949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 933/1873] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:07.430700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5940dd-7f2a-4fed-a244-ac1ea726c0a2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:07.520874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5940dd-7f2a-4fed-a244-ac1ea726c0a2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:07.526265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb96ac-8c64-40fd-96c2-e05641583939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:07.532299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb96ac-8c64-40fd-96c2-e05641583939 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.532299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb96ac-8c64-40fd-96c2-e05641583939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.532299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb96ac-8c64-40fd-96c2-e05641583939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.532299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb96ac-8c64-40fd-96c2-e05641583939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:07.532299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb96ac-8c64-40fd-96c2-e05641583939 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:07.655262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 941/1874] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:07 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:07.659020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d344b-837a-4599-b8ea-14fa37c02c31 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:07.670129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d344b-837a-4599-b8ea-14fa37c02c31 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:07.728487 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175d286-bbb3-4143-8ffb-082d5ef336fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:07.729244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d286-bbb3-4143-8ffb-082d5ef336fb admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.729494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d286-bbb3-4143-8ffb-082d5ef336fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.729762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d286-bbb3-4143-8ffb-082d5ef336fb admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.731023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175d286-bbb3-4143-8ffb-082d5ef336fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:07.732410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175d286-bbb3-4143-8ffb-082d5ef336fb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:07.829314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:07.865146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 934/1875] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:07 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:07.869077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb96ac-8c64-40fd-96c2-e05641583939 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:07.880171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb96ac-8c64-40fd-96c2-e05641583939 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:07.886418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c316a19-5fe8-42d6-8487-9e2dad9017b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:07.886852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c316a19-5fe8-42d6-8487-9e2dad9017b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.887192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c316a19-5fe8-42d6-8487-9e2dad9017b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.887468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c316a19-5fe8-42d6-8487-9e2dad9017b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.888308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c316a19-5fe8-42d6-8487-9e2dad9017b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:07.890526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c316a19-5fe8-42d6-8487-9e2dad9017b0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:07.908818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 942/1876] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:07.909846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175d286-bbb3-4143-8ffb-082d5ef336fb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:07.921389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175d286-bbb3-4143-8ffb-082d5ef336fb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:07.927102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e610-e149-46dd-90a3-ff7de9e349aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:07.928196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e610-e149-46dd-90a3-ff7de9e349aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.928655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e610-e149-46dd-90a3-ff7de9e349aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.929030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e610-e149-46dd-90a3-ff7de9e349aa admin admin] PATH_INFO: `/v3/projects/8dbf4769aef145b68b5a0e24f89a89ff/users/17be8b4a9a914e9abadc84fd45054651/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.952811 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9e610-e149-46dd-90a3-ff7de9e349aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbf4769aef145b68b5a0e24f89a89ff, user_id=17be8b4a9a914e9abadc84fd45054651, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:07.955716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9e610-e149-46dd-90a3-ff7de9e349aa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:08.030302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 935/1877] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:07 2022] PUT /identity/v3/projects/8dbf4769aef145b68b5a0e24f89a89ff/users/17be8b4a9a914e9abadc84fd45054651/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:08.035252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c316a19-5fe8-42d6-8487-9e2dad9017b0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:08.045312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c316a19-5fe8-42d6-8487-9e2dad9017b0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:08.098644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:08.109268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e86de2-4445-481d-b351-327dbf43409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:08.109948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86de2-4445-481d-b351-327dbf43409a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:08.110225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86de2-4445-481d-b351-327dbf43409a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:08.110507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86de2-4445-481d-b351-327dbf43409a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:08.111229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e86de2-4445-481d-b351-327dbf43409a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:08.113064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e86de2-4445-481d-b351-327dbf43409a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:08.125276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 943/1878] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:08.128718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e610-e149-46dd-90a3-ff7de9e349aa admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:08.140961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e610-e149-46dd-90a3-ff7de9e349aa admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:08.146106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:08.147198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:08.147491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:08.147815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] PATH_INFO: `/v3/projects/8dbf4769aef145b68b5a0e24f89a89ff/users/17be8b4a9a914e9abadc84fd45054651/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:08.150598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbf4769aef145b68b5a0e24f89a89ff, user_id=17be8b4a9a914e9abadc84fd45054651, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:08.153756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:08.175617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 936/1879] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:08 2022] PUT /identity/v3/projects/8dbf4769aef145b68b5a0e24f89a89ff/users/17be8b4a9a914e9abadc84fd45054651/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:08.177143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6e15-4744-46e4-954e-d4bc239be05e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:08.177590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6e15-4744-46e4-954e-d4bc239be05e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:08.177749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6e15-4744-46e4-954e-d4bc239be05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:08.221770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ec6c6e15-4744-46e4-954e-d4bc239be05e None None] MFA Rules not processed for user `17be8b4a9a914e9abadc84fd45054651`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:08.223356 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ec6c6e15-4744-46e4-954e-d4bc239be05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:08.328026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 944/1880] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:08.336638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:08.339230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:08.415058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59725048-a7a5-4ebd-9a2a-81c1ca452e5b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:08.420861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef07d2-ab3f-41d1-9d37-d9c6fd456a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:08.421536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef07d2-ab3f-41d1-9d37-d9c6fd456a95 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:08.422376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef07d2-ab3f-41d1-9d37-d9c6fd456a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:08.422376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef07d2-ab3f-41d1-9d37-d9c6fd456a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:08.485184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef07d2-ab3f-41d1-9d37-d9c6fd456a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:08.486926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef07d2-ab3f-41d1-9d37-d9c6fd456a95 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:08.496818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 937/1881] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:08.766066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:09.548793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c6e15-4744-46e4-954e-d4bc239be05e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:09.550224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ec6c6e15-4744-46e4-954e-d4bc239be05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:09.621997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c6e15-4744-46e4-954e-d4bc239be05e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:09.627634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:09.628645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:09.628994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:09.629339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] PATH_INFO: `/v3/users/9aff125b0f9847ef913565b302fc672d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:09.630611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aff125b0f9847ef913565b302fc672d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:09.632649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:09.876075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aff125b0f9847ef913565b302fc672d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:09.899549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aff125b0f9847ef913565b302fc672d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:10.018725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aff125b0f9847ef913565b302fc672d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:10.019812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aff125b0f9847ef913565b302fc672d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:10.033298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aff125b0f9847ef913565b302fc672d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:10.040163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 945/1882] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:09 2022] DELETE /identity/v3/users/9aff125b0f9847ef913565b302fc672d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:10.044665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ada442-df63-4b37-b309-6e2e37bad2a5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:10.045680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ada442-df63-4b37-b309-6e2e37bad2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:10.045799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ada442-df63-4b37-b309-6e2e37bad2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:10.065793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e2ada442-df63-4b37-b309-6e2e37bad2a5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:10.067238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e2ada442-df63-4b37-b309-6e2e37bad2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:10.114209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:10.133428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 938/1883] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:10.150797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:10.152289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:10.160226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:10.220689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3294c-1057-47e7-a1ef-ddefdd6dfd74 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:10.225194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c514b-c4fa-41b9-b703-2aaf4992a88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:10.225859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c514b-c4fa-41b9-b703-2aaf4992a88c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:10.226144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c514b-c4fa-41b9-b703-2aaf4992a88c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:10.226426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c514b-c4fa-41b9-b703-2aaf4992a88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:10.239324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c514b-c4fa-41b9-b703-2aaf4992a88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:10.241692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c514b-c4fa-41b9-b703-2aaf4992a88c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:10.264366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 946/1884] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:10.810536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ada442-df63-4b37-b309-6e2e37bad2a5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:10.812224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e2ada442-df63-4b37-b309-6e2e37bad2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:10.825597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ada442-df63-4b37-b309-6e2e37bad2a5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:10.832939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:10.841099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:10.841395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:10.841700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] PATH_INFO: `/v3/projects/7634e947b7d94ae9b7df4831a9d95352` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:10.843614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7634e947b7d94ae9b7df4831a9d95352)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:10.845568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:10.964177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7634e947b7d94ae9b7df4831a9d95352', 'request_id': 'req-cec36941-4297-41d9-869d-6434a5b09fff'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:10.970147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7634e947b7d94ae9b7df4831a9d95352', 'request_id': 'req-cec36941-4297-41d9-869d-6434a5b09fff'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:10.978051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7634e947b7d94ae9b7df4831a9d95352', 'request_id': 'req-cec36941-4297-41d9-869d-6434a5b09fff'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:11.048301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] The token cache is being invalidate because project 7634e947b7d94ae9b7df4831a9d95352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:11.048913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:11.049279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:11.052413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 939/1885] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:10 2022] DELETE /identity/v3/projects/7634e947b7d94ae9b7df4831a9d95352 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:11.054973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c514b-c4fa-41b9-b703-2aaf4992a88c service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:11.065907 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c514b-c4fa-41b9-b703-2aaf4992a88c service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:11.129500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:11.130371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:11.130649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:11.130927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] PATH_INFO: `/v3/users/230d5b4c76994f43bc6a3ac91371443b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:11.132611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=230d5b4c76994f43bc6a3ac91371443b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:11.134730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:11.182227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:11.251022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:11.304132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230d5b4c76994f43bc6a3ac91371443b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:11.311474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230d5b4c76994f43bc6a3ac91371443b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:11.353521 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230d5b4c76994f43bc6a3ac91371443b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:11.354168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230d5b4c76994f43bc6a3ac91371443b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:11.367176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6f45c4ee-e5a7-41ba-925d-18e48cec7e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230d5b4c76994f43bc6a3ac91371443b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:11.373864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 947/1886] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:11 2022] DELETE /identity/v3/users/230d5b4c76994f43bc6a3ac91371443b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:11.540969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:11.818261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:11.819803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:11.841333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec36941-4297-41d9-869d-6434a5b09fff admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:11.868577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:11.907734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:11.908656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:11.908945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:11.909225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] PATH_INFO: `/v3/projects/02b4ff1565954245a12cb59d80acf647` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:11.910479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b4ff1565954245a12cb59d80acf647)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:11.912599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:12.031092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b4ff1565954245a12cb59d80acf647', 'request_id': 'req-f9adf361-abdd-454e-bf8f-7d2fd4be8190'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:12.036713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b4ff1565954245a12cb59d80acf647', 'request_id': 'req-f9adf361-abdd-454e-bf8f-7d2fd4be8190'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:12.043702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b4ff1565954245a12cb59d80acf647', 'request_id': 'req-f9adf361-abdd-454e-bf8f-7d2fd4be8190'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:12.142338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] The token cache is being invalidate because project 02b4ff1565954245a12cb59d80acf647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:12.142939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:12.143407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f9adf361-abdd-454e-bf8f-7d2fd4be8190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:12.145047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 940/1887] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:11 2022] DELETE /identity/v3/projects/02b4ff1565954245a12cb59d80acf647 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:12.150013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c319-0411-49c7-810b-6dacbd2951a7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.152662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c319-0411-49c7-810b-6dacbd2951a7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.152662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83c319-0411-49c7-810b-6dacbd2951a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.169210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1d83c319-0411-49c7-810b-6dacbd2951a7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:12.170475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d83c319-0411-49c7-810b-6dacbd2951a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:12.250897 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 948/1888] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:12.253947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1521f-13e0-453c-9c62-d69e47f86ddf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.254300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1521f-13e0-453c-9c62-d69e47f86ddf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.254584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1521f-13e0-453c-9c62-d69e47f86ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.283138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-adf1521f-13e0-453c-9c62-d69e47f86ddf None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:12.284475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-adf1521f-13e0-453c-9c62-d69e47f86ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:12.292962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 941/1889] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:12.296948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c319-0411-49c7-810b-6dacbd2951a7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:12.317935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83c319-0411-49c7-810b-6dacbd2951a7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:12.336236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:12.337205 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.337709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.338034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.339473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:12.339960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:12.345122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:12.367880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 949/1890] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:12.372292 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1521f-13e0-453c-9c62-d69e47f86ddf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:12.382965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1521f-13e0-453c-9c62-d69e47f86ddf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:12.389505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49082ab9-551d-471c-8da1-50505fa27b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:12.390197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082ab9-551d-471c-8da1-50505fa27b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.390502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082ab9-551d-471c-8da1-50505fa27b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.390777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49082ab9-551d-471c-8da1-50505fa27b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.391473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49082ab9-551d-471c-8da1-50505fa27b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:12.393421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49082ab9-551d-471c-8da1-50505fa27b07 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:12.403546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:12.426336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:12.496869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 942/1891] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:12 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:12.501529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:12.511934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5540-69ad-4446-993a-1e5d872a75ae admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:12.569165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136028a6-80dc-4624-99b9-ac2cfb7774de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:12.569838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136028a6-80dc-4624-99b9-ac2cfb7774de admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.570117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136028a6-80dc-4624-99b9-ac2cfb7774de admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.570398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136028a6-80dc-4624-99b9-ac2cfb7774de admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.571097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136028a6-80dc-4624-99b9-ac2cfb7774de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:12.573069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136028a6-80dc-4624-99b9-ac2cfb7774de admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:12.667054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 950/1892] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:12 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:12.671497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49082ab9-551d-471c-8da1-50505fa27b07 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:12.683054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49082ab9-551d-471c-8da1-50505fa27b07 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:12.688761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d98e3-71e9-44d5-97cc-8520acf1e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:12.689502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d98e3-71e9-44d5-97cc-8520acf1e2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.689766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d98e3-71e9-44d5-97cc-8520acf1e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.690040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d98e3-71e9-44d5-97cc-8520acf1e2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.690780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d98e3-71e9-44d5-97cc-8520acf1e2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:12.692420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d98e3-71e9-44d5-97cc-8520acf1e2cd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:12.705558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 943/1893] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:12.711459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136028a6-80dc-4624-99b9-ac2cfb7774de admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:12.721917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136028a6-80dc-4624-99b9-ac2cfb7774de admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:12.726683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88067aa8-ed8c-483c-bbee-f7beebdfe8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:12.727343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067aa8-ed8c-483c-bbee-f7beebdfe8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.727624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067aa8-ed8c-483c-bbee-f7beebdfe8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.727921 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067aa8-ed8c-483c-bbee-f7beebdfe8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.728667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88067aa8-ed8c-483c-bbee-f7beebdfe8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:12.730263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88067aa8-ed8c-483c-bbee-f7beebdfe8e9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:12.741660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 951/1894] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:12.745918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d98e3-71e9-44d5-97cc-8520acf1e2cd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:12.756620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d98e3-71e9-44d5-97cc-8520acf1e2cd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:12.761458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5222450-7f06-4abf-a038-581d691bff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:12.762324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5222450-7f06-4abf-a038-581d691bff2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.762601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5222450-7f06-4abf-a038-581d691bff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.762873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5222450-7f06-4abf-a038-581d691bff2b admin admin] PATH_INFO: `/v3/projects/7bda18eafe774474971bbbbfb96b7816/users/c76ccf16ee394eb8b004a5d85f4d71a6/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.778195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5222450-7f06-4abf-a038-581d691bff2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bda18eafe774474971bbbbfb96b7816, user_id=c76ccf16ee394eb8b004a5d85f4d71a6, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:12.780962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5222450-7f06-4abf-a038-581d691bff2b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:12.856208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 944/1895] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:12 2022] PUT /identity/v3/projects/7bda18eafe774474971bbbbfb96b7816/users/c76ccf16ee394eb8b004a5d85f4d71a6/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:12.867697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f352c5-60ba-4496-b8b3-7a5503ecd740 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:12.868026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f352c5-60ba-4496-b8b3-7a5503ecd740 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:12.868310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f352c5-60ba-4496-b8b3-7a5503ecd740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:12.899824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-34f352c5-60ba-4496-b8b3-7a5503ecd740 None None] MFA Rules not processed for user `c76ccf16ee394eb8b004a5d85f4d71a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:12.901072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-34f352c5-60ba-4496-b8b3-7a5503ecd740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:12.964850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 952/1896] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:12.969260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5222450-7f06-4abf-a038-581d691bff2b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:13.030509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5222450-7f06-4abf-a038-581d691bff2b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:13.036291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bf8de-a668-4139-9071-72781c20afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:13.036972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bf8de-a668-4139-9071-72781c20afd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:13.037247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bf8de-a668-4139-9071-72781c20afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:13.037521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bf8de-a668-4139-9071-72781c20afd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:13.038223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bf8de-a668-4139-9071-72781c20afd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:13.040152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bf8de-a668-4139-9071-72781c20afd8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:13.057369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:13.184219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 945/1897] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:12 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:13.189094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f352c5-60ba-4496-b8b3-7a5503ecd740 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:13.200085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f352c5-60ba-4496-b8b3-7a5503ecd740 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:13.265895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07989f5-2813-40d5-83c1-8ff42c158b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:13.266796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07989f5-2813-40d5-83c1-8ff42c158b4b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:13.266915 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07989f5-2813-40d5-83c1-8ff42c158b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:13.267155 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07989f5-2813-40d5-83c1-8ff42c158b4b admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:13.267847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07989f5-2813-40d5-83c1-8ff42c158b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:13.269888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07989f5-2813-40d5-83c1-8ff42c158b4b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:13.365713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 953/1898] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:13 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:13.366749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bf8de-a668-4139-9071-72781c20afd8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:13.378212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bf8de-a668-4139-9071-72781c20afd8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:13.383652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fe63-be1b-4dad-8e36-dfc66ea679e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:13.384391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fe63-be1b-4dad-8e36-dfc66ea679e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:13.384825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fe63-be1b-4dad-8e36-dfc66ea679e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:13.385261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fe63-be1b-4dad-8e36-dfc66ea679e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:13.386245 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96fe63-be1b-4dad-8e36-dfc66ea679e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:13.388264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96fe63-be1b-4dad-8e36-dfc66ea679e2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:13.403381 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 946/1899] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:13.405092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07989f5-2813-40d5-83c1-8ff42c158b4b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:13.421750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07989f5-2813-40d5-83c1-8ff42c158b4b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:13.427144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314542bd-bbae-4d7d-86c4-9da5a98aad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:13.428420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314542bd-bbae-4d7d-86c4-9da5a98aad13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:13.429183 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314542bd-bbae-4d7d-86c4-9da5a98aad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:13.430726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:13.431211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314542bd-bbae-4d7d-86c4-9da5a98aad13 admin admin] PATH_INFO: `/v3/projects/3a8b411fe14643e29d1f1f9b168b03b9/users/d6282b605736441599bdd8c23b245bc0/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:13.450151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314542bd-bbae-4d7d-86c4-9da5a98aad13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8b411fe14643e29d1f1f9b168b03b9, user_id=d6282b605736441599bdd8c23b245bc0, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:13.452879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314542bd-bbae-4d7d-86c4-9da5a98aad13 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:13.485512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:13.546562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 954/1900] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:13 2022] PUT /identity/v3/projects/3a8b411fe14643e29d1f1f9b168b03b9/users/d6282b605736441599bdd8c23b245bc0/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:13.547863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fe63-be1b-4dad-8e36-dfc66ea679e2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:13.559489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fe63-be1b-4dad-8e36-dfc66ea679e2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:13.646146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e822c0f-e986-41e5-8aea-f2956033ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:13.647093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e822c0f-e986-41e5-8aea-f2956033ed48 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:13.647312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e822c0f-e986-41e5-8aea-f2956033ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:13.647561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e822c0f-e986-41e5-8aea-f2956033ed48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:13.648323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e822c0f-e986-41e5-8aea-f2956033ed48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:13.650243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e822c0f-e986-41e5-8aea-f2956033ed48 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:13.665109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 947/1901] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:13.666248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314542bd-bbae-4d7d-86c4-9da5a98aad13 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:13.677451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314542bd-bbae-4d7d-86c4-9da5a98aad13 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:13.682347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:13.683223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:13.683506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:13.683784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] PATH_INFO: `/v3/projects/3a8b411fe14643e29d1f1f9b168b03b9/users/d6282b605736441599bdd8c23b245bc0/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:13.685819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8b411fe14643e29d1f1f9b168b03b9, user_id=d6282b605736441599bdd8c23b245bc0, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:13.688635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:13.699443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 955/1902] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:13 2022] PUT /identity/v3/projects/3a8b411fe14643e29d1f1f9b168b03b9/users/d6282b605736441599bdd8c23b245bc0/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:13.711217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc5ab-9fa0-4f68-b3f2-33154dc3cc73 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:13.711502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc5ab-9fa0-4f68-b3f2-33154dc3cc73 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:13.711804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dc5ab-9fa0-4f68-b3f2-33154dc3cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:13.740797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-331dc5ab-9fa0-4f68-b3f2-33154dc3cc73 None None] MFA Rules not processed for user `d6282b605736441599bdd8c23b245bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:13.743261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-331dc5ab-9fa0-4f68-b3f2-33154dc3cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:13.816528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 948/1903] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:13.828443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:13.830191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:13.877314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:13.898404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79dd4b-4aeb-46b9-a183-558625709132 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:13.902143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25710f-81b9-43ff-9d3d-32af37b49b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:13.902786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25710f-81b9-43ff-9d3d-32af37b49b96 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:13.903067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25710f-81b9-43ff-9d3d-32af37b49b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:13.903339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25710f-81b9-43ff-9d3d-32af37b49b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:13.913243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25710f-81b9-43ff-9d3d-32af37b49b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:13.914671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25710f-81b9-43ff-9d3d-32af37b49b96 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:13.924405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 956/1904] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:13.942569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:13.987879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dc5ab-9fa0-4f68-b3f2-33154dc3cc73 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:14.052013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dc5ab-9fa0-4f68-b3f2-33154dc3cc73 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:14.056893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:14.057941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:14.058221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:14.058495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] PATH_INFO: `/v3/users/c76ccf16ee394eb8b004a5d85f4d71a6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:14.060076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76ccf16ee394eb8b004a5d85f4d71a6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:14.062573 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:14.226407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:14.285437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76ccf16ee394eb8b004a5d85f4d71a6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:14.382358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76ccf16ee394eb8b004a5d85f4d71a6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:14.395336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:14.396889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76ccf16ee394eb8b004a5d85f4d71a6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:14.397800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76ccf16ee394eb8b004a5d85f4d71a6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:14.404979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76ccf16ee394eb8b004a5d85f4d71a6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:14.411415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 949/1905] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:13 2022] DELETE /identity/v3/users/c76ccf16ee394eb8b004a5d85f4d71a6 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:14.416107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d8b2-12f6-4a7e-b5bc-6b5cdd1d6301 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:14.416421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d8b2-12f6-4a7e-b5bc-6b5cdd1d6301 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:14.416698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d8b2-12f6-4a7e-b5bc-6b5cdd1d6301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:14.444312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8784d8b2-12f6-4a7e-b5bc-6b5cdd1d6301 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:14.449942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8784d8b2-12f6-4a7e-b5bc-6b5cdd1d6301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:14.513739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 957/1906] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:14.523479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:14.524966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:14.584962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d921152-6faa-4713-b39a-29dff73b273d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:14.588761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:14.589414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:14.589700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:14.589975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:14.600384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:14.601895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:14.611662 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 950/1907] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:14.662509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:14.922939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d8b2-12f6-4a7e-b5bc-6b5cdd1d6301 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:14.924520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8784d8b2-12f6-4a7e-b5bc-6b5cdd1d6301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:14.937095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d8b2-12f6-4a7e-b5bc-6b5cdd1d6301 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:14.942854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:14.943612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:14.943892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:14.944195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] PATH_INFO: `/v3/users/820bb862103e4a13bd103fe02612d12d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:14.945779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=820bb862103e4a13bd103fe02612d12d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:14.947960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:15.091055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:15.092553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:15.105638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f12ff-fcf4-4738-a29a-f216df12abe9 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:15.111109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:15.112142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:15.112273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:15.112546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] PATH_INFO: `/v3/projects/7bda18eafe774474971bbbbfb96b7816` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:15.113900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bda18eafe774474971bbbbfb96b7816)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:15.115808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:15.166620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:15.195266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820bb862103e4a13bd103fe02612d12d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.202434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820bb862103e4a13bd103fe02612d12d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.261598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bda18eafe774474971bbbbfb96b7816', 'request_id': 'req-6f30c5a3-1b57-498a-8d74-8e81b482018f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.267328 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bda18eafe774474971bbbbfb96b7816', 'request_id': 'req-6f30c5a3-1b57-498a-8d74-8e81b482018f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.273793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bda18eafe774474971bbbbfb96b7816', 'request_id': 'req-6f30c5a3-1b57-498a-8d74-8e81b482018f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.283026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820bb862103e4a13bd103fe02612d12d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.283809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820bb862103e4a13bd103fe02612d12d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.296663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-654588b5-d782-433b-9832-61f87780f6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820bb862103e4a13bd103fe02612d12d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.302823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 958/1908] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:14 2022] DELETE /identity/v3/users/820bb862103e4a13bd103fe02612d12d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:15.307588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e96e-1414-4423-b158-f394043c65d6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:15.308063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e96e-1414-4423-b158-f394043c65d6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:15.308526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e96e-1414-4423-b158-f394043c65d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:15.327885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a582e96e-1414-4423-b158-f394043c65d6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:15.329105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a582e96e-1414-4423-b158-f394043c65d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:15.386467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 959/1909] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:15.396998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e96e-1414-4423-b158-f394043c65d6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:15.398337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a582e96e-1414-4423-b158-f394043c65d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:15.408662 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] The token cache is being invalidate because project 7bda18eafe774474971bbbbfb96b7816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:15.409158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.409675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.411895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 951/1910] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:15 2022] DELETE /identity/v3/projects/7bda18eafe774474971bbbbfb96b7816 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:15.415463 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:15.416801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:15.456386 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e96e-1414-4423-b158-f394043c65d6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:15.459839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:15.460658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:15.460919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:15.461221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:15.463098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:15.476053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:15.477621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:15.482315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c5a3-1b57-498a-8d74-8e81b482018f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:15.487686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:15.488727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:15.489377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 960/1911] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:15.489489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:15.489646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] PATH_INFO: `/v3/users/d6282b605736441599bdd8c23b245bc0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:15.490999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6282b605736441599bdd8c23b245bc0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:15.493141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:15.510081 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:15.710770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6282b605736441599bdd8c23b245bc0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.838972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6282b605736441599bdd8c23b245bc0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.864500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6282b605736441599bdd8c23b245bc0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.865359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6282b605736441599bdd8c23b245bc0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.872785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6282b605736441599bdd8c23b245bc0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:15.880124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 952/1912] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:15 2022] DELETE /identity/v3/users/d6282b605736441599bdd8c23b245bc0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:16.025549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:16.033811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:16.048346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f51a4b-17d5-459d-8aea-02b01b820b99 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:16.132629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:16.133522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:16.133804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:16.134083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] PATH_INFO: `/v3/projects/e8440ab48ec543fbb49c08cd25c9ca81` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:16.135299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8440ab48ec543fbb49c08cd25c9ca81)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:16.139171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:16.200497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:16.245501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8440ab48ec543fbb49c08cd25c9ca81', 'request_id': 'req-615fdf26-07fe-4759-90bc-9acd15afc296'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.251506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8440ab48ec543fbb49c08cd25c9ca81', 'request_id': 'req-615fdf26-07fe-4759-90bc-9acd15afc296'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.259222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8440ab48ec543fbb49c08cd25c9ca81', 'request_id': 'req-615fdf26-07fe-4759-90bc-9acd15afc296'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.340053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] The token cache is being invalidate because project e8440ab48ec543fbb49c08cd25c9ca81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:16.341323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.342399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.344224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 961/1913] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:16 2022] DELETE /identity/v3/projects/e8440ab48ec543fbb49c08cd25c9ca81 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:16.348343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:16.349914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:16.363689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f5826-9dbe-4f62-b6c2-e482f685e530 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:16.425355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:16.426365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:16.426688 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:16.427022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] PATH_INFO: `/v3/users/17be8b4a9a914e9abadc84fd45054651` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:16.428321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17be8b4a9a914e9abadc84fd45054651)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:16.430299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:16.509226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:16.514287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:16.525922 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fdf26-07fe-4759-90bc-9acd15afc296 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:16.542511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:16.543435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:16.543705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:16.544011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] PATH_INFO: `/v3/projects/3a8b411fe14643e29d1f1f9b168b03b9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:16.545229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8b411fe14643e29d1f1f9b168b03b9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:16.547182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:16.655917 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17be8b4a9a914e9abadc84fd45054651'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.659171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8b411fe14643e29d1f1f9b168b03b9', 'request_id': 'req-b00dc573-564d-446e-83a4-1c9d372d17d6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.667167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8b411fe14643e29d1f1f9b168b03b9', 'request_id': 'req-b00dc573-564d-446e-83a4-1c9d372d17d6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.675869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8b411fe14643e29d1f1f9b168b03b9', 'request_id': 'req-b00dc573-564d-446e-83a4-1c9d372d17d6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.752343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17be8b4a9a914e9abadc84fd45054651'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.767458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17be8b4a9a914e9abadc84fd45054651'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.768303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17be8b4a9a914e9abadc84fd45054651'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.775215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee7b621d-8522-4196-8267-6beca4cd8140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17be8b4a9a914e9abadc84fd45054651'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.784443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 953/1914] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:16 2022] DELETE /identity/v3/users/17be8b4a9a914e9abadc84fd45054651 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:16.843702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] The token cache is being invalidate because project 3a8b411fe14643e29d1f1f9b168b03b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:16.844030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.845950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b00dc573-564d-446e-83a4-1c9d372d17d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:16.849073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 962/1915] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:16 2022] DELETE /identity/v3/projects/3a8b411fe14643e29d1f1f9b168b03b9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:16.852697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c4ff-5892-4cb5-ba13-468dc7f2b727 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:16.853174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c4ff-5892-4cb5-ba13-468dc7f2b727 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:16.853460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1c4ff-5892-4cb5-ba13-468dc7f2b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:16.878423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-92f1c4ff-5892-4cb5-ba13-468dc7f2b727 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:16.879639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-92f1c4ff-5892-4cb5-ba13-468dc7f2b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:16.887354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:16.947609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 954/1916] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:16.956998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe36b28-0a89-476c-b8be-a135dd4d3606 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:16.957353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe36b28-0a89-476c-b8be-a135dd4d3606 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:16.957638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe36b28-0a89-476c-b8be-a135dd4d3606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:16.977834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fbe36b28-0a89-476c-b8be-a135dd4d3606 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:16.979020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fbe36b28-0a89-476c-b8be-a135dd4d3606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:16.987810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 963/1917] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:16.993016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1c4ff-5892-4cb5-ba13-468dc7f2b727 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.005908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1c4ff-5892-4cb5-ba13-468dc7f2b727 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.008036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.008771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.009113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.009452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.010256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:17.010818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.012436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.024226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 955/1918] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:17.028939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe36b28-0a89-476c-b8be-a135dd4d3606 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.039846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe36b28-0a89-476c-b8be-a135dd4d3606 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.046340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.048285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.048789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.049069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.049773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.052335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.143245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:17.151455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 964/1919] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:17.156913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.173178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af705ebc-9b0c-46bd-93c8-4d33cc54a936 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.270898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cf1f-e642-490a-b825-e5da2d741117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.281087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cf1f-e642-490a-b825-e5da2d741117 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.281087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cf1f-e642-490a-b825-e5da2d741117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.281087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7cf1f-e642-490a-b825-e5da2d741117 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.281087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7cf1f-e642-490a-b825-e5da2d741117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.281087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7cf1f-e642-490a-b825-e5da2d741117 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.394363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 956/1920] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:17.394516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.396007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:17.398837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cf1f-e642-490a-b825-e5da2d741117 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.411835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b441-663a-412d-a521-b298ef723473 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.412855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7cf1f-e642-490a-b825-e5da2d741117 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.417952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50575265-ff2b-49b7-b7de-4342aa223a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.418096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.418693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575265-ff2b-49b7-b7de-4342aa223a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.418918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575265-ff2b-49b7-b7de-4342aa223a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.419226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575265-ff2b-49b7-b7de-4342aa223a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.419520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.420457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575265-ff2b-49b7-b7de-4342aa223a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.420756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.421118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] PATH_INFO: `/v3/projects/8dbf4769aef145b68b5a0e24f89a89ff` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.422242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575265-ff2b-49b7-b7de-4342aa223a82 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.422860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbf4769aef145b68b5a0e24f89a89ff)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.424725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.433051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 957/1921] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:17.437654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50575265-ff2b-49b7-b7de-4342aa223a82 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.447480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50575265-ff2b-49b7-b7de-4342aa223a82 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.452146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587d62-b329-4480-9c08-dd9bdfa98e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.452798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587d62-b329-4480-9c08-dd9bdfa98e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.453083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587d62-b329-4480-9c08-dd9bdfa98e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.453362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587d62-b329-4480-9c08-dd9bdfa98e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.454078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80587d62-b329-4480-9c08-dd9bdfa98e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.455665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80587d62-b329-4480-9c08-dd9bdfa98e0d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.466401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 958/1922] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:17.470286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587d62-b329-4480-9c08-dd9bdfa98e0d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.480403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587d62-b329-4480-9c08-dd9bdfa98e0d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.485708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a82f8-05fa-4bb2-a7ed-4b363ff672b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.486588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a82f8-05fa-4bb2-a7ed-4b363ff672b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.486872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a82f8-05fa-4bb2-a7ed-4b363ff672b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.487150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a82f8-05fa-4bb2-a7ed-4b363ff672b9 admin admin] PATH_INFO: `/v3/projects/33d14c2d30b6474b8a80592ecf9d981e/users/cbee801b992a47d7a7472b78a8dd9bd5/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.502454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a82f8-05fa-4bb2-a7ed-4b363ff672b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d14c2d30b6474b8a80592ecf9d981e, user_id=cbee801b992a47d7a7472b78a8dd9bd5, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.505239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a82f8-05fa-4bb2-a7ed-4b363ff672b9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.593556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 959/1923] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:17 2022] PUT /identity/v3/projects/33d14c2d30b6474b8a80592ecf9d981e/users/cbee801b992a47d7a7472b78a8dd9bd5/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:17.601068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbf4769aef145b68b5a0e24f89a89ff', 'request_id': 'req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:17.604839 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164c98-756d-4fdd-b5eb-0c28ae203602 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.605137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164c98-756d-4fdd-b5eb-0c28ae203602 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.605428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e164c98-756d-4fdd-b5eb-0c28ae203602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.606897 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbf4769aef145b68b5a0e24f89a89ff', 'request_id': 'req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:17.616287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbf4769aef145b68b5a0e24f89a89ff', 'request_id': 'req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:17.632882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8e164c98-756d-4fdd-b5eb-0c28ae203602 None None] MFA Rules not processed for user `cbee801b992a47d7a7472b78a8dd9bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:17.634341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8e164c98-756d-4fdd-b5eb-0c28ae203602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:17.667139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] The token cache is being invalidate because project 8dbf4769aef145b68b5a0e24f89a89ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:17.667508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:17.668399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-810f5849-ab30-4fbb-ac37-e7c85a6f9adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:17.675180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 965/1924] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:17 2022] DELETE /identity/v3/projects/8dbf4769aef145b68b5a0e24f89a89ff => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:17.676542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0c6d4-cdd1-4c92-88b7-511c63b4df0a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.676829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0c6d4-cdd1-4c92-88b7-511c63b4df0a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.677096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0c6d4-cdd1-4c92-88b7-511c63b4df0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.696414 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-51c0c6d4-cdd1-4c92-88b7-511c63b4df0a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:17.697763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-51c0c6d4-cdd1-4c92-88b7-511c63b4df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:17.698376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 960/1925] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:17.702748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e164c98-756d-4fdd-b5eb-0c28ae203602 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.704054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8e164c98-756d-4fdd-b5eb-0c28ae203602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:17.765666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 966/1926] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:17.769630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e164c98-756d-4fdd-b5eb-0c28ae203602 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.773539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8359bc-19d6-4122-adef-835aeb80bf21 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.773858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8359bc-19d6-4122-adef-835aeb80bf21 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.774137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8359bc-19d6-4122-adef-835aeb80bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.774809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b68b80-52ba-4a12-b371-d2151921891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.775503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b68b80-52ba-4a12-b371-d2151921891b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.775778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b68b80-52ba-4a12-b371-d2151921891b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.776093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b68b80-52ba-4a12-b371-d2151921891b admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.776788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b68b80-52ba-4a12-b371-d2151921891b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.778678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b68b80-52ba-4a12-b371-d2151921891b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.796588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8e8359bc-19d6-4122-adef-835aeb80bf21 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:17.797783 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8e8359bc-19d6-4122-adef-835aeb80bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:17.805638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 967/1927] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:17.809596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8359bc-19d6-4122-adef-835aeb80bf21 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.818376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8359bc-19d6-4122-adef-835aeb80bf21 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.822767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.823390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.823670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.823974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.824688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:17.824990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.826599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.837659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 968/1928] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:17.842193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.851128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318bc54-6b8e-4a4d-a42b-e62faba1c956 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:17.856098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c10a07-04ee-49c5-9bbb-3d47f036514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:17.856690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c10a07-04ee-49c5-9bbb-3d47f036514b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:17.856975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c10a07-04ee-49c5-9bbb-3d47f036514b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:17.857909 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c10a07-04ee-49c5-9bbb-3d47f036514b admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:17.858569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c10a07-04ee-49c5-9bbb-3d47f036514b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:17.860455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c10a07-04ee-49c5-9bbb-3d47f036514b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:17.968677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 961/1929] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:17.968865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 969/1930] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:17.968946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b68b80-52ba-4a12-b371-d2151921891b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:17.969944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c10a07-04ee-49c5-9bbb-3d47f036514b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.026768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b68b80-52ba-4a12-b371-d2151921891b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.030278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c10a07-04ee-49c5-9bbb-3d47f036514b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.032261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db492b1-70f3-4cb5-83b6-bdd2f1056e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.032923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db492b1-70f3-4cb5-83b6-bdd2f1056e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.033203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db492b1-70f3-4cb5-83b6-bdd2f1056e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.033477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db492b1-70f3-4cb5-83b6-bdd2f1056e5a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.034170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db492b1-70f3-4cb5-83b6-bdd2f1056e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.035433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f830-95c3-45d4-8344-60c63554b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.036096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db492b1-70f3-4cb5-83b6-bdd2f1056e5a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.036279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f830-95c3-45d4-8344-60c63554b792 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.036628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f830-95c3-45d4-8344-60c63554b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.036972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7f830-95c3-45d4-8344-60c63554b792 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.037719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7f830-95c3-45d4-8344-60c63554b792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.039847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7f830-95c3-45d4-8344-60c63554b792 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.152617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 962/1931] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:18.156870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db492b1-70f3-4cb5-83b6-bdd2f1056e5a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.166429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db492b1-70f3-4cb5-83b6-bdd2f1056e5a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.172236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7cb37-416c-4b1b-a519-b7760da78473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.172876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7cb37-416c-4b1b-a519-b7760da78473 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.173155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7cb37-416c-4b1b-a519-b7760da78473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.173425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7cb37-416c-4b1b-a519-b7760da78473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.174142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7cb37-416c-4b1b-a519-b7760da78473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.175785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7cb37-416c-4b1b-a519-b7760da78473 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.177724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 970/1932] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:17 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:18.183100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f830-95c3-45d4-8344-60c63554b792 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.186177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 963/1933] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:18.189758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7cb37-416c-4b1b-a519-b7760da78473 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.193649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7f830-95c3-45d4-8344-60c63554b792 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.198915 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd4dc-27db-4b3b-aa21-b042346a7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.199558 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd4dc-27db-4b3b-aa21-b042346a7b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.199840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd4dc-27db-4b3b-aa21-b042346a7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.200014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7cb37-416c-4b1b-a519-b7760da78473 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.200574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd4dc-27db-4b3b-aa21-b042346a7b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.201395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cd4dc-27db-4b3b-aa21-b042346a7b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.203142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cd4dc-27db-4b3b-aa21-b042346a7b28 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.205495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77cb0c-2cd0-46c0-a271-83c6e5729056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.206204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77cb0c-2cd0-46c0-a271-83c6e5729056 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.206539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77cb0c-2cd0-46c0-a271-83c6e5729056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.206881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77cb0c-2cd0-46c0-a271-83c6e5729056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.207689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77cb0c-2cd0-46c0-a271-83c6e5729056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.209529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77cb0c-2cd0-46c0-a271-83c6e5729056 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.213713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 971/1934] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:18.224476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 964/1935] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:18.224644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd4dc-27db-4b3b-aa21-b042346a7b28 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.225973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77cb0c-2cd0-46c0-a271-83c6e5729056 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.236980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd4dc-27db-4b3b-aa21-b042346a7b28 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.245141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e4589-0a86-4d89-885c-87aa9cc08c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.249283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e4589-0a86-4d89-885c-87aa9cc08c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.249283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e4589-0a86-4d89-885c-87aa9cc08c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.249283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e4589-0a86-4d89-885c-87aa9cc08c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.249593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77cb0c-2cd0-46c0-a271-83c6e5729056 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.249685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e4589-0a86-4d89-885c-87aa9cc08c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.249685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e4589-0a86-4d89-885c-87aa9cc08c37 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.261582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6fce9-02b6-421e-88aa-62507af2a6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.262493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6fce9-02b6-421e-88aa-62507af2a6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.262772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6fce9-02b6-421e-88aa-62507af2a6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.263210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6fce9-02b6-421e-88aa-62507af2a6bc admin admin] PATH_INFO: `/v3/projects/5cce0d9c89224c1fb072a00343ee2f6d/users/e5e09a0387f54b3cb6f08ac341e47a93/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.274282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 972/1936] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:18.274622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:18.276899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e4589-0a86-4d89-885c-87aa9cc08c37 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.296968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e4589-0a86-4d89-885c-87aa9cc08c37 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.301416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6fce9-02b6-421e-88aa-62507af2a6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cce0d9c89224c1fb072a00343ee2f6d, user_id=e5e09a0387f54b3cb6f08ac341e47a93, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.302143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6fce9-02b6-421e-88aa-62507af2a6bc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.309757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08667-dfbc-4df5-8014-a48cad5b870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.310695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08667-dfbc-4df5-8014-a48cad5b870b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.310966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08667-dfbc-4df5-8014-a48cad5b870b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.311242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08667-dfbc-4df5-8014-a48cad5b870b admin admin] PATH_INFO: `/v3/projects/c44c4f14b5f04c2aa6585ac5d3b2d2a8/users/94db038cce364dd487ee170a4e1c8ad0/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.332906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd08667-dfbc-4df5-8014-a48cad5b870b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44c4f14b5f04c2aa6585ac5d3b2d2a8, user_id=94db038cce364dd487ee170a4e1c8ad0, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.336961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd08667-dfbc-4df5-8014-a48cad5b870b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.376413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 965/1937] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:18 2022] PUT /identity/v3/projects/5cce0d9c89224c1fb072a00343ee2f6d/users/e5e09a0387f54b3cb6f08ac341e47a93/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:18.385856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496028-ce39-4440-ad42-3eb1f68ce874 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.386288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496028-ce39-4440-ad42-3eb1f68ce874 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.386523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca496028-ce39-4440-ad42-3eb1f68ce874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.420313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ca496028-ce39-4440-ad42-3eb1f68ce874 None None] MFA Rules not processed for user `e5e09a0387f54b3cb6f08ac341e47a93`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:18.421836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ca496028-ce39-4440-ad42-3eb1f68ce874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:18.467685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 973/1938] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:18 2022] PUT /identity/v3/projects/c44c4f14b5f04c2aa6585ac5d3b2d2a8/users/94db038cce364dd487ee170a4e1c8ad0/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:18.484658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01217-05c4-410a-a932-15a18cff4283 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.485031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01217-05c4-410a-a932-15a18cff4283 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.485377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01217-05c4-410a-a932-15a18cff4283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.510214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 966/1939] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:18.514693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca496028-ce39-4440-ad42-3eb1f68ce874 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.520101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-86b01217-05c4-410a-a932-15a18cff4283 None None] MFA Rules not processed for user `94db038cce364dd487ee170a4e1c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:18.521319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-86b01217-05c4-410a-a932-15a18cff4283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:18.573888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca496028-ce39-4440-ad42-3eb1f68ce874 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.577778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:18.586492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 974/1940] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:18.623443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01217-05c4-410a-a932-15a18cff4283 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.625146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-86b01217-05c4-410a-a932-15a18cff4283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:18.631442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a632ed-9e2d-4345-8760-39a92e28dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.632172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a632ed-9e2d-4345-8760-39a92e28dc87 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.632453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a632ed-9e2d-4345-8760-39a92e28dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.632727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a632ed-9e2d-4345-8760-39a92e28dc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.633424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a632ed-9e2d-4345-8760-39a92e28dc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.635352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a632ed-9e2d-4345-8760-39a92e28dc87 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.682081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01217-05c4-410a-a932-15a18cff4283 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.686352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891760-215d-48ce-a5b9-63948630c5a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.686990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891760-215d-48ce-a5b9-63948630c5a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.687267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891760-215d-48ce-a5b9-63948630c5a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.687533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891760-215d-48ce-a5b9-63948630c5a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.695582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e891760-215d-48ce-a5b9-63948630c5a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.697026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e891760-215d-48ce-a5b9-63948630c5a0 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.706248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 975/1941] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:18.745956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 967/1942] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:18 2022] POST /identity/v3/projects => generated 377 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:18.750655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891760-215d-48ce-a5b9-63948630c5a0 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.761612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891760-215d-48ce-a5b9-63948630c5a0 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.818315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7024b10-81e5-4385-970c-a7778431fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.818988 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024b10-81e5-4385-970c-a7778431fd9d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.819274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024b10-81e5-4385-970c-a7778431fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.819554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024b10-81e5-4385-970c-a7778431fd9d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.821541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7024b10-81e5-4385-970c-a7778431fd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.823205 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7024b10-81e5-4385-970c-a7778431fd9d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.937098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 976/1943] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:18 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:18.940939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a632ed-9e2d-4345-8760-39a92e28dc87 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.951022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a632ed-9e2d-4345-8760-39a92e28dc87 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:18.955594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0008977-4392-4c51-b451-bd005128932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:18.956288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0008977-4392-4c51-b451-bd005128932e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:18.956569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0008977-4392-4c51-b451-bd005128932e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:18.956840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0008977-4392-4c51-b451-bd005128932e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:18.957705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0008977-4392-4c51-b451-bd005128932e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:18.959143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0008977-4392-4c51-b451-bd005128932e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:18.981472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 968/1944] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:18.983609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7024b10-81e5-4385-970c-a7778431fd9d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:18.996578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7024b10-81e5-4385-970c-a7778431fd9d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:19.003189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdcf43-ffd4-494c-bfaa-a03e2d16d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:19.004329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdcf43-ffd4-494c-bfaa-a03e2d16d764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:19.004795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdcf43-ffd4-494c-bfaa-a03e2d16d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:19.005268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdcf43-ffd4-494c-bfaa-a03e2d16d764 admin admin] PATH_INFO: `/v3/projects/fd93698d769d458b9ac824fbe0bfc731/users/0946dc0ec7da4a7f8272feccf40de9ea/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:19.022634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdcf43-ffd4-494c-bfaa-a03e2d16d764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd93698d769d458b9ac824fbe0bfc731, user_id=0946dc0ec7da4a7f8272feccf40de9ea, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:19.025363 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdcf43-ffd4-494c-bfaa-a03e2d16d764 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:19.051131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:19.097302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 977/1945] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:18 2022] PUT /identity/v3/projects/fd93698d769d458b9ac824fbe0bfc731/users/0946dc0ec7da4a7f8272feccf40de9ea/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:19.101273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0008977-4392-4c51-b451-bd005128932e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:19.112899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0008977-4392-4c51-b451-bd005128932e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:19.172020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747e2f0-54ed-41d6-a218-dcf5a3bfd790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:19.172679 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747e2f0-54ed-41d6-a218-dcf5a3bfd790 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:19.172960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747e2f0-54ed-41d6-a218-dcf5a3bfd790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:19.173233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747e2f0-54ed-41d6-a218-dcf5a3bfd790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:19.173941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747e2f0-54ed-41d6-a218-dcf5a3bfd790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:19.175546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747e2f0-54ed-41d6-a218-dcf5a3bfd790 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:19.186809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 969/1946] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:19.194288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdcf43-ffd4-494c-bfaa-a03e2d16d764 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:19.205967 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdcf43-ffd4-494c-bfaa-a03e2d16d764 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:19.210946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:19.211713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:19.212171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:19.212586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] PATH_INFO: `/v3/projects/fd93698d769d458b9ac824fbe0bfc731/users/0946dc0ec7da4a7f8272feccf40de9ea/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:19.214753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd93698d769d458b9ac824fbe0bfc731, user_id=0946dc0ec7da4a7f8272feccf40de9ea, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:19.219228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:19.234675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 978/1947] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:19 2022] PUT /identity/v3/projects/fd93698d769d458b9ac824fbe0bfc731/users/0946dc0ec7da4a7f8272feccf40de9ea/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:19.244828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec91a3-50af-4587-b895-8616d892c1bf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:19.245122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec91a3-50af-4587-b895-8616d892c1bf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:19.245400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec91a3-50af-4587-b895-8616d892c1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:19.272633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8fec91a3-50af-4587-b895-8616d892c1bf None None] MFA Rules not processed for user `0946dc0ec7da4a7f8272feccf40de9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:19.274124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8fec91a3-50af-4587-b895-8616d892c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:19.300829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:19.358644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 970/1948] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:19.370389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:19.372153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:19.379807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec91a3-50af-4587-b895-8616d892c1bf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:19.381268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8fec91a3-50af-4587-b895-8616d892c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:19.395782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:19.445268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4019b-63bb-4627-90a6-9f80ae468e27 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:19.449003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc1ed3-8bf6-4245-9d35-04dedb5ffdc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:19.449679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc1ed3-8bf6-4245-9d35-04dedb5ffdc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:19.449966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc1ed3-8bf6-4245-9d35-04dedb5ffdc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:19.450251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc1ed3-8bf6-4245-9d35-04dedb5ffdc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:19.462368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc1ed3-8bf6-4245-9d35-04dedb5ffdc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:19.464860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc1ed3-8bf6-4245-9d35-04dedb5ffdc2 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:19.472650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec91a3-50af-4587-b895-8616d892c1bf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:19.474986 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 979/1949] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:19.480810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:19.481604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:19.481884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:19.482218 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] PATH_INFO: `/v3/users/4b4503f682944545a21e152a4361ac76` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:19.483517 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4503f682944545a21e152a4361ac76)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:19.485515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:19.565675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc1ed3-8bf6-4245-9d35-04dedb5ffdc2 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:19.575392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc1ed3-8bf6-4245-9d35-04dedb5ffdc2 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:19.589940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878d524-60f4-46dc-89f8-91efe98403c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:19.590610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d524-60f4-46dc-89f8-91efe98403c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:19.590895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d524-60f4-46dc-89f8-91efe98403c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:19.591170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d524-60f4-46dc-89f8-91efe98403c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:19.651810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878d524-60f4-46dc-89f8-91efe98403c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:19.653951 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878d524-60f4-46dc-89f8-91efe98403c2 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:19.668182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 980/1950] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:19.768275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4503f682944545a21e152a4361ac76'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:19.851525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4503f682944545a21e152a4361ac76'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:19.864264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:19.870354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4503f682944545a21e152a4361ac76'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:19.871165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4503f682944545a21e152a4361ac76'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:19.879448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4503f682944545a21e152a4361ac76'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:19.887121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 971/1951] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:19 2022] DELETE /identity/v3/users/4b4503f682944545a21e152a4361ac76 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:19.891605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55232eed-3f73-433d-a61d-85783042d6e9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:19.894312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55232eed-3f73-433d-a61d-85783042d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:19.894312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55232eed-3f73-433d-a61d-85783042d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:19.911585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-55232eed-3f73-433d-a61d-85783042d6e9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:19.913055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-55232eed-3f73-433d-a61d-85783042d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:19.972611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 981/1952] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:19.982663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:19.984097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:20.040893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ad5e0-0f9a-4a4c-83cb-feaacb4f2e18 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:20.044670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:20.046023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:20.046319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:20.046598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:20.058481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:20.063620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:20.073369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 972/1953] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:20.111980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:20.504230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8e77-f6f5-4dc7-af29-428bcea831b9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:20.504887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8e77-f6f5-4dc7-af29-428bcea831b9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:20.504887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8e77-f6f5-4dc7-af29-428bcea831b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:20.524104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-297a8e77-f6f5-4dc7-af29-428bcea831b9 None None] MFA Rules not processed for user `94db038cce364dd487ee170a4e1c8ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:20.526062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-297a8e77-f6f5-4dc7-af29-428bcea831b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:20.592929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 982/1954] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:20.603235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:20.606095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:20.638007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b4fda-8660-4867-95fd-ef1a55bd8ff9 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:20.644216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:20.646631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:20.647316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:20.647674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] PATH_INFO: `/v3/projects/c8657f2c5b7048b79727c0fb22aaf8dc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:20.649234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8657f2c5b7048b79727c0fb22aaf8dc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:20.656907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:20.789846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8657f2c5b7048b79727c0fb22aaf8dc', 'request_id': 'req-989c8355-35d3-45f5-8de4-8e78bc4b0234'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:20.798643 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8657f2c5b7048b79727c0fb22aaf8dc', 'request_id': 'req-989c8355-35d3-45f5-8de4-8e78bc4b0234'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:20.806547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8657f2c5b7048b79727c0fb22aaf8dc', 'request_id': 'req-989c8355-35d3-45f5-8de4-8e78bc4b0234'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:20.869609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] The token cache is being invalidate because project c8657f2c5b7048b79727c0fb22aaf8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:20.870064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:20.870810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:20.873760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 973/1955] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:20 2022] DELETE /identity/v3/projects/c8657f2c5b7048b79727c0fb22aaf8dc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:20.877965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8e77-f6f5-4dc7-af29-428bcea831b9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:20.896768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8e77-f6f5-4dc7-af29-428bcea831b9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:20.961671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:20.962530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:20.967745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:20.967745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] PATH_INFO: `/v3/users/c1b79db34dea454abc59175a4e2cd8a6` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:20.967745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b79db34dea454abc59175a4e2cd8a6)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:20.967745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:21.194776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b79db34dea454abc59175a4e2cd8a6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:21.202102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b79db34dea454abc59175a4e2cd8a6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:21.284773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b79db34dea454abc59175a4e2cd8a6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:21.285423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b79db34dea454abc59175a4e2cd8a6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:21.301339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e61906c-d5b8-4cc8-9453-1d166591cab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b79db34dea454abc59175a4e2cd8a6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:21.312616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 983/1956] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:20 2022] DELETE /identity/v3/users/c1b79db34dea454abc59175a4e2cd8a6 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:21.375177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:21.790410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:21.792073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:21.806478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8355-35d3-45f5-8de4-8e78bc4b0234 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:21.842369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:21.867893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:21.868780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:21.869084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:21.869352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] PATH_INFO: `/v3/projects/acf431f3c1e846cebc0d460f7f1cd0b5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:21.870608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf431f3c1e846cebc0d460f7f1cd0b5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:21.872581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:22.003793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf431f3c1e846cebc0d460f7f1cd0b5', 'request_id': 'req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:22.006289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:22.010213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf431f3c1e846cebc0d460f7f1cd0b5', 'request_id': 'req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:22.021813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf431f3c1e846cebc0d460f7f1cd0b5', 'request_id': 'req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:22.110230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] The token cache is being invalidate because project acf431f3c1e846cebc0d460f7f1cd0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:22.110460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:22.111452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0f9bb981-7cf8-4fa5-a3ed-8db26ef86515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:22.120177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 974/1957] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:21 2022] DELETE /identity/v3/projects/acf431f3c1e846cebc0d460f7f1cd0b5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:22.125808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a71e-dd11-439a-b25a-c294b3dfda73 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.126094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a71e-dd11-439a-b25a-c294b3dfda73 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.126662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a71e-dd11-439a-b25a-c294b3dfda73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.152737 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7b00a71e-dd11-439a-b25a-c294b3dfda73 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:22.155021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7b00a71e-dd11-439a-b25a-c294b3dfda73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:22.225560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 984/1958] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:22.233234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ff3f-4aba-4a2f-98e6-b3b264d6160e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.233518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ff3f-4aba-4a2f-98e6-b3b264d6160e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.233797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ff3f-4aba-4a2f-98e6-b3b264d6160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.252651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bbc0ff3f-4aba-4a2f-98e6-b3b264d6160e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:22.253895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bbc0ff3f-4aba-4a2f-98e6-b3b264d6160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:22.262964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 975/1959] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:22.267825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a71e-dd11-439a-b25a-c294b3dfda73 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:22.277355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a71e-dd11-439a-b25a-c294b3dfda73 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:22.284270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:22.284928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.285219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.285500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.286359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:22.286672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:22.288406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:22.299779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 985/1960] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:22.304313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ff3f-4aba-4a2f-98e6-b3b264d6160e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:22.314636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ff3f-4aba-4a2f-98e6-b3b264d6160e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:22.320013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7f862-0bb1-451c-8a36-11cad00ad4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:22.320666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7f862-0bb1-451c-8a36-11cad00ad4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.320953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7f862-0bb1-451c-8a36-11cad00ad4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.321228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7f862-0bb1-451c-8a36-11cad00ad4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.321957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7f862-0bb1-451c-8a36-11cad00ad4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:22.323979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7f862-0bb1-451c-8a36-11cad00ad4e5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:22.389738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 976/1961] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:22 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:22.393765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:22.405094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65786e9-c8c8-462c-bbf3-35c7a74d20a3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:22.466207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe030ce6-eb3c-45fa-a515-6fe2f9e9e301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:22.466992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030ce6-eb3c-45fa-a515-6fe2f9e9e301 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.467290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030ce6-eb3c-45fa-a515-6fe2f9e9e301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.467555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe030ce6-eb3c-45fa-a515-6fe2f9e9e301 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.468329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe030ce6-eb3c-45fa-a515-6fe2f9e9e301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:22.470383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe030ce6-eb3c-45fa-a515-6fe2f9e9e301 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:22.557588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:22.611626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 986/1962] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:22 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:22.618916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7f862-0bb1-451c-8a36-11cad00ad4e5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:22.632625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7f862-0bb1-451c-8a36-11cad00ad4e5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:22.637976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f090db-fa4b-4550-870d-c6ff69a08b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:22.638890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f090db-fa4b-4550-870d-c6ff69a08b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.639259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f090db-fa4b-4550-870d-c6ff69a08b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.639600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f090db-fa4b-4550-870d-c6ff69a08b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.640476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f090db-fa4b-4550-870d-c6ff69a08b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:22.642118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f090db-fa4b-4550-870d-c6ff69a08b47 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:22.662867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 977/1963] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:22.663842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe030ce6-eb3c-45fa-a515-6fe2f9e9e301 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:22.675082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe030ce6-eb3c-45fa-a515-6fe2f9e9e301 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:22.681089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc740b-e0d4-44d7-8a10-60dddbae4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:22.681766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc740b-e0d4-44d7-8a10-60dddbae4d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.682856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc740b-e0d4-44d7-8a10-60dddbae4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.683171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc740b-e0d4-44d7-8a10-60dddbae4d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.686364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc740b-e0d4-44d7-8a10-60dddbae4d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:22.688226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc740b-e0d4-44d7-8a10-60dddbae4d3b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:22.703322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 987/1964] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:22.707539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f090db-fa4b-4550-870d-c6ff69a08b47 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:22.718143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f090db-fa4b-4550-870d-c6ff69a08b47 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:22.723017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5c7f-0b07-4995-bd10-70eed06f9b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:22.723890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5c7f-0b07-4995-bd10-70eed06f9b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.724218 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5c7f-0b07-4995-bd10-70eed06f9b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.724488 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5c7f-0b07-4995-bd10-70eed06f9b76 admin admin] PATH_INFO: `/v3/projects/4588d0aa21a142269da5b0ce53eb5013/users/55f6907afb8949398c9b9479aaa998dc/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.741910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5c7f-0b07-4995-bd10-70eed06f9b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4588d0aa21a142269da5b0ce53eb5013, user_id=55f6907afb8949398c9b9479aaa998dc, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:22.744887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5c7f-0b07-4995-bd10-70eed06f9b76 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:22.852239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 978/1965] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:22 2022] PUT /identity/v3/projects/4588d0aa21a142269da5b0ce53eb5013/users/55f6907afb8949398c9b9479aaa998dc/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:22.863449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41aae-3417-456e-b9f7-cfd5e0ee489f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:22.863805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41aae-3417-456e-b9f7-cfd5e0ee489f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:22.864224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41aae-3417-456e-b9f7-cfd5e0ee489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:22.899133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3ec41aae-3417-456e-b9f7-cfd5e0ee489f None None] MFA Rules not processed for user `55f6907afb8949398c9b9479aaa998dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:22.900380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ec41aae-3417-456e-b9f7-cfd5e0ee489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:22.966173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:22.986054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 988/1966] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:22.991088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5c7f-0b07-4995-bd10-70eed06f9b76 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:23.075241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5c7f-0b07-4995-bd10-70eed06f9b76 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:23.080775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6150e6c-8636-482d-98d9-8321baeb794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:23.081568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6150e6c-8636-482d-98d9-8321baeb794d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.082060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6150e6c-8636-482d-98d9-8321baeb794d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.082506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6150e6c-8636-482d-98d9-8321baeb794d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.083474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6150e6c-8636-482d-98d9-8321baeb794d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:23.085713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6150e6c-8636-482d-98d9-8321baeb794d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:23.096644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:23.201671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 979/1967] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:22 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:23.205546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec41aae-3417-456e-b9f7-cfd5e0ee489f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:23.220749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec41aae-3417-456e-b9f7-cfd5e0ee489f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:23.308553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5ad57-5faa-425b-8f09-4423125b7c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:23.309438 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5ad57-5faa-425b-8f09-4423125b7c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.309958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5ad57-5faa-425b-8f09-4423125b7c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.310435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5ad57-5faa-425b-8f09-4423125b7c13 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.311520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5ad57-5faa-425b-8f09-4423125b7c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:23.313977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5ad57-5faa-425b-8f09-4423125b7c13 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:23.449344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 989/1968] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:23 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:23.453970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6150e6c-8636-482d-98d9-8321baeb794d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:23.468485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6150e6c-8636-482d-98d9-8321baeb794d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:23.474759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072bb1-a0fd-4d81-b7ef-3506a67ade77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:23.475386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072bb1-a0fd-4d81-b7ef-3506a67ade77 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.475807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072bb1-a0fd-4d81-b7ef-3506a67ade77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.476110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072bb1-a0fd-4d81-b7ef-3506a67ade77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.476847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d072bb1-a0fd-4d81-b7ef-3506a67ade77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:23.483269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d072bb1-a0fd-4d81-b7ef-3506a67ade77 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:23.489632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 980/1969] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:23.493827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5ad57-5faa-425b-8f09-4423125b7c13 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:23.504104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5ad57-5faa-425b-8f09-4423125b7c13 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:23.509080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75510d-a802-4374-85ac-28e0fc60f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:23.512220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75510d-a802-4374-85ac-28e0fc60f25c admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.512220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75510d-a802-4374-85ac-28e0fc60f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.512220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75510d-a802-4374-85ac-28e0fc60f25c admin admin] PATH_INFO: `/v3/projects/cb379301a736420592f74683efcc4607/users/61265dbc52b6420e81b6382ebf31bc20/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.533654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75510d-a802-4374-85ac-28e0fc60f25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb379301a736420592f74683efcc4607, user_id=61265dbc52b6420e81b6382ebf31bc20, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:23.536608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75510d-a802-4374-85ac-28e0fc60f25c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:23.691090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 990/1970] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:23 2022] PUT /identity/v3/projects/cb379301a736420592f74683efcc4607/users/61265dbc52b6420e81b6382ebf31bc20/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:23.695174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072bb1-a0fd-4d81-b7ef-3506a67ade77 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:23.705527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072bb1-a0fd-4d81-b7ef-3506a67ade77 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:23.766838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff567f4-eb4a-49cb-9b22-1d17e599cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:23.767508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff567f4-eb4a-49cb-9b22-1d17e599cf98 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.767795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff567f4-eb4a-49cb-9b22-1d17e599cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.768101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff567f4-eb4a-49cb-9b22-1d17e599cf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.768856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff567f4-eb4a-49cb-9b22-1d17e599cf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:23.770447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff567f4-eb4a-49cb-9b22-1d17e599cf98 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:23.780316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 981/1971] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:23.784567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75510d-a802-4374-85ac-28e0fc60f25c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:23.795128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75510d-a802-4374-85ac-28e0fc60f25c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:23.799629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:23.800530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.800812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.801087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] PATH_INFO: `/v3/projects/cb379301a736420592f74683efcc4607/users/61265dbc52b6420e81b6382ebf31bc20/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.803388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb379301a736420592f74683efcc4607, user_id=61265dbc52b6420e81b6382ebf31bc20, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:23.806069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:23.817948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 991/1972] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:23 2022] PUT /identity/v3/projects/cb379301a736420592f74683efcc4607/users/61265dbc52b6420e81b6382ebf31bc20/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:23.828983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947debcf-4579-4f9f-8005-ee8415ae401e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.829431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947debcf-4579-4f9f-8005-ee8415ae401e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.829744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947debcf-4579-4f9f-8005-ee8415ae401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.877048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-947debcf-4579-4f9f-8005-ee8415ae401e None None] MFA Rules not processed for user `61265dbc52b6420e81b6382ebf31bc20`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:23.879165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-947debcf-4579-4f9f-8005-ee8415ae401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:23.970072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 982/1973] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:23.982139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:23.983971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:24.044005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a028-81d7-4d35-ac01-f5edb9a83bb2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:24.048549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6de4c8-2d3a-4d8b-80e0-cda62960061c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:24.049408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6de4c8-2d3a-4d8b-80e0-cda62960061c service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:24.049792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6de4c8-2d3a-4d8b-80e0-cda62960061c service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:24.050212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6de4c8-2d3a-4d8b-80e0-cda62960061c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:24.060723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6de4c8-2d3a-4d8b-80e0-cda62960061c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:24.062303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6de4c8-2d3a-4d8b-80e0-cda62960061c service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:24.073221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 992/1974] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:24.571126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947debcf-4579-4f9f-8005-ee8415ae401e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:24.572544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-947debcf-4579-4f9f-8005-ee8415ae401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:24.648203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947debcf-4579-4f9f-8005-ee8415ae401e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:24.653267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:24.654624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:24.654902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:24.655185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] PATH_INFO: `/v3/users/43c272b0d7044717839e3285209b6f57` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:24.656417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c272b0d7044717839e3285209b6f57)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:24.658372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:24.660228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:24.846095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c272b0d7044717839e3285209b6f57'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:24.922848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c272b0d7044717839e3285209b6f57'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:24.947774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c272b0d7044717839e3285209b6f57'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:24.953772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c272b0d7044717839e3285209b6f57'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:24.963783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c272b0d7044717839e3285209b6f57'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:24.972195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 983/1975] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:24 2022] DELETE /identity/v3/users/43c272b0d7044717839e3285209b6f57 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:25.099747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6de4c8-2d3a-4d8b-80e0-cda62960061c service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:25.110267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6de4c8-2d3a-4d8b-80e0-cda62960061c service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:25.136235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:25.137650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:25.164422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:25.181689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:25.183096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:25.183388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:25.183669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] PATH_INFO: `/v3/users/55f6907afb8949398c9b9479aaa998dc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:25.185706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f6907afb8949398c9b9479aaa998dc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:25.198388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:25.214380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c834b9-3813-4c89-956d-69719080e9fa admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:25.221514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:25.222749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:25.223281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:25.223650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] PATH_INFO: `/v3/users/cbee801b992a47d7a7472b78a8dd9bd5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:25.226563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbee801b992a47d7a7472b78a8dd9bd5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:25.228068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:25.400945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f6907afb8949398c9b9479aaa998dc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.408354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f6907afb8949398c9b9479aaa998dc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.469380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbee801b992a47d7a7472b78a8dd9bd5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.508098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f6907afb8949398c9b9479aaa998dc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.509499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f6907afb8949398c9b9479aaa998dc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.524434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f6907afb8949398c9b9479aaa998dc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.535183 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 993/1976] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:25 2022] DELETE /identity/v3/users/55f6907afb8949398c9b9479aaa998dc => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:25.539013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:25.539013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:25.616060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbee801b992a47d7a7472b78a8dd9bd5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.622376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ff13-84ee-453e-bdf2-b00da5cb736e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:25.629856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:25.631504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:25.631794 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:25.632109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] PATH_INFO: `/v3/projects/e47b81532c9449d2b9787da4f8d18532` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:25.633460 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47b81532c9449d2b9787da4f8d18532)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:25.635670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:25.636707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbee801b992a47d7a7472b78a8dd9bd5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.637704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbee801b992a47d7a7472b78a8dd9bd5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.649816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af61bb-9775-475e-96ad-4b290bb0a3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbee801b992a47d7a7472b78a8dd9bd5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.652658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:25.662946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 984/1977] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:25 2022] DELETE /identity/v3/users/cbee801b992a47d7a7472b78a8dd9bd5 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:25.664582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420466d4-c1cf-41c2-b5e1-9d1f8a760a3a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:25.665012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420466d4-c1cf-41c2-b5e1-9d1f8a760a3a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:25.665624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420466d4-c1cf-41c2-b5e1-9d1f8a760a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:25.689097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-420466d4-c1cf-41c2-b5e1-9d1f8a760a3a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:25.690243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-420466d4-c1cf-41c2-b5e1-9d1f8a760a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:25.771009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 985/1978] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:25.775922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0169c-85b7-4b8a-bf02-69d8585a78ae None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:25.776334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0169c-85b7-4b8a-bf02-69d8585a78ae None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:25.776647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0169c-85b7-4b8a-bf02-69d8585a78ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:25.800118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-85c0169c-85b7-4b8a-bf02-69d8585a78ae None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:25.801514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-85c0169c-85b7-4b8a-bf02-69d8585a78ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:25.812869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47b81532c9449d2b9787da4f8d18532', 'request_id': 'req-ab55c42b-6efa-4289-a94d-1a275a7b76c8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.821220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47b81532c9449d2b9787da4f8d18532', 'request_id': 'req-ab55c42b-6efa-4289-a94d-1a275a7b76c8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.829172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47b81532c9449d2b9787da4f8d18532', 'request_id': 'req-ab55c42b-6efa-4289-a94d-1a275a7b76c8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.885831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 986/1979] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:25.887295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0169c-85b7-4b8a-bf02-69d8585a78ae None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:25.888653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-85c0169c-85b7-4b8a-bf02-69d8585a78ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:25.925080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] The token cache is being invalidate because project e47b81532c9449d2b9787da4f8d18532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:25.925474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.926717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:25.928556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 994/1980] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:25 2022] DELETE /identity/v3/projects/e47b81532c9449d2b9787da4f8d18532 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:25.929487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:25.930803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:25.964730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0169c-85b7-4b8a-bf02-69d8585a78ae None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:25.971799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:25.972919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:25.973215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:25.973477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:25.985681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:26.000126 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:26.001571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:26.007442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55c42b-6efa-4289-a94d-1a275a7b76c8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:26.013585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7076a6-73a6-4c98-9777-7bf48c11ee3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:26.014563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7076a6-73a6-4c98-9777-7bf48c11ee3d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:26.015051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7076a6-73a6-4c98-9777-7bf48c11ee3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:26.016002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7076a6-73a6-4c98-9777-7bf48c11ee3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:26.020088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a7076a6-73a6-4c98-9777-7bf48c11ee3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:26.022985 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 987/1981] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:26.023824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:26.026672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:26.038107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7076a6-73a6-4c98-9777-7bf48c11ee3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:26.040108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7076a6-73a6-4c98-9777-7bf48c11ee3d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:26.042080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30ada-22e4-41b3-beb5-3061ed20c1cd service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:26.049121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:26.050318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:26.050947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:26.051413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] PATH_INFO: `/v3/users/80e8f4a691904c04975c2bb64769d522` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:26.053325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e8f4a691904c04975c2bb64769d522)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:26.059384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:26.067089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 995/1982] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:26.069296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9ab9-de83-4299-8a1f-467e04880f37 None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:26.070576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9ab9-de83-4299-8a1f-467e04880f37 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:26.070968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc9ab9-de83-4299-8a1f-467e04880f37 None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:26.073323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 996/1983] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:41:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:41:26.090939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6ac9-a26b-41b5-82fe-157c02614969 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:26.092192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6ac9-a26b-41b5-82fe-157c02614969 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:26.092700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6ac9-a26b-41b5-82fe-157c02614969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:26.117643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e0ae6ac9-a26b-41b5-82fe-157c02614969 None None] MFA Rules not processed for user `f6cc8de6532145799454b27e742259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:26.118968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e0ae6ac9-a26b-41b5-82fe-157c02614969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:26.192253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 997/1984] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:41:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:26.203845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6ac9-a26b-41b5-82fe-157c02614969 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:26.206004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e0ae6ac9-a26b-41b5-82fe-157c02614969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:26.223642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6ac9-a26b-41b5-82fe-157c02614969 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:26.231435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:26.232889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:26.233241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:26.233604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:26.248437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:26.251015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:26.262927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 998/1985] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:26.264096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:26.266148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:26.291277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3724-3e6e-4e8c-a052-be5fbd0e1c82 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:26.292415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e8f4a691904c04975c2bb64769d522'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.298203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:26.299289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:26.299725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:26.300192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] PATH_INFO: `/v3/users/4acef8b517cc41e684dfa9b3a765edb8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:26.301671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4acef8b517cc41e684dfa9b3a765edb8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:26.303962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:26.377074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e8f4a691904c04975c2bb64769d522'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.377569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:26.391146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e8f4a691904c04975c2bb64769d522'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.391862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e8f4a691904c04975c2bb64769d522'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.398748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e8f4a691904c04975c2bb64769d522'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.405497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 988/1986] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:26 2022] DELETE /identity/v3/users/80e8f4a691904c04975c2bb64769d522 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:26.518546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4acef8b517cc41e684dfa9b3a765edb8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.527576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4acef8b517cc41e684dfa9b3a765edb8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.593934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4acef8b517cc41e684dfa9b3a765edb8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.595413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4acef8b517cc41e684dfa9b3a765edb8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.625141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4acef8b517cc41e684dfa9b3a765edb8'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.660626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 999/1987] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:26 2022] DELETE /identity/v3/users/4acef8b517cc41e684dfa9b3a765edb8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:26.737760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:26.740691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:26.770777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:26.772407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:26.873704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d06632-3975-4be4-8630-68c0b49d9215 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:26.880141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:26.881023 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:26.881872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:26.881872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] PATH_INFO: `/v3/projects/4588d0aa21a142269da5b0ce53eb5013` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:26.883043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4588d0aa21a142269da5b0ce53eb5013)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:26.886533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:26.889328 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1071a5b-3728-4ec6-ba2c-0bd8b7b2a510 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:26.895516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:26.896661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:26.900994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:26.900994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] PATH_INFO: `/v3/projects/933adf224fed4a6b8621a4a1bb4d008f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:26.900994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933adf224fed4a6b8621a4a1bb4d008f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:26.900994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:26.981924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4588d0aa21a142269da5b0ce53eb5013', 'request_id': 'req-86334301-77ac-401d-8a41-875890984b8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.987671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4588d0aa21a142269da5b0ce53eb5013', 'request_id': 'req-86334301-77ac-401d-8a41-875890984b8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:26.998482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4588d0aa21a142269da5b0ce53eb5013', 'request_id': 'req-86334301-77ac-401d-8a41-875890984b8b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.012390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933adf224fed4a6b8621a4a1bb4d008f', 'request_id': 'req-1f7527fa-9c2e-4617-a537-b8db56dcc960'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.019992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933adf224fed4a6b8621a4a1bb4d008f', 'request_id': 'req-1f7527fa-9c2e-4617-a537-b8db56dcc960'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.027248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933adf224fed4a6b8621a4a1bb4d008f', 'request_id': 'req-1f7527fa-9c2e-4617-a537-b8db56dcc960'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.137616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] The token cache is being invalidate because project 4588d0aa21a142269da5b0ce53eb5013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:27.142057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.142057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.142057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1000/1988] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:26 2022] DELETE /identity/v3/projects/4588d0aa21a142269da5b0ce53eb5013 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:27.142677 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:27.144437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:27.195063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] The token cache is being invalidate because project 933adf224fed4a6b8621a4a1bb4d008f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:27.195162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.199815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.199815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 989/1989] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:26 2022] DELETE /identity/v3/projects/933adf224fed4a6b8621a4a1bb4d008f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:27.199815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:27.200087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:27.249090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86334301-77ac-401d-8a41-875890984b8b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:27.273620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7527fa-9c2e-4617-a537-b8db56dcc960 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:27.278797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:27.279972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:27.280501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:27.287404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] PATH_INFO: `/v3/users/61265dbc52b6420e81b6382ebf31bc20` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:27.287404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61265dbc52b6420e81b6382ebf31bc20)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:27.287404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:27.309245 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:27.321657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:27.322524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:27.322805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:27.323079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] PATH_INFO: `/v3/projects/33d14c2d30b6474b8a80592ecf9d981e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:27.324291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d14c2d30b6474b8a80592ecf9d981e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:27.326229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:27.493886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61265dbc52b6420e81b6382ebf31bc20'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.507572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d14c2d30b6474b8a80592ecf9d981e', 'request_id': 'req-b619c52d-272d-43db-9818-5805a4cbc346'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.513424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d14c2d30b6474b8a80592ecf9d981e', 'request_id': 'req-b619c52d-272d-43db-9818-5805a4cbc346'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.519476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d14c2d30b6474b8a80592ecf9d981e', 'request_id': 'req-b619c52d-272d-43db-9818-5805a4cbc346'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.582030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61265dbc52b6420e81b6382ebf31bc20'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.594885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61265dbc52b6420e81b6382ebf31bc20'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.595606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61265dbc52b6420e81b6382ebf31bc20'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.602571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61265dbc52b6420e81b6382ebf31bc20'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.609359 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 990/1990] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:27 2022] DELETE /identity/v3/users/61265dbc52b6420e81b6382ebf31bc20 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:27.612461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:27.612461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:27.676814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d3cc-476d-4678-b482-3f805fdbc2a0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:27.681633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:27.682497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:27.682778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:27.683054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] PATH_INFO: `/v3/projects/7c72ff79bb364f0d9bc9d9397abd5318` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:27.684297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c72ff79bb364f0d9bc9d9397abd5318)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:27.686252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:27.696700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] The token cache is being invalidate because project 33d14c2d30b6474b8a80592ecf9d981e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:27.697109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.703000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b619c52d-272d-43db-9818-5805a4cbc346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.703000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1001/1991] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:27 2022] DELETE /identity/v3/projects/33d14c2d30b6474b8a80592ecf9d981e => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:27.703000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4968d9-1f09-48ff-90f2-b6a819eb0b1f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:27.703000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4968d9-1f09-48ff-90f2-b6a819eb0b1f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:27.703000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4968d9-1f09-48ff-90f2-b6a819eb0b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:27.724680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1d4968d9-1f09-48ff-90f2-b6a819eb0b1f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:27.726080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d4968d9-1f09-48ff-90f2-b6a819eb0b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:27.735782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1002/1992] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:27.736627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4968d9-1f09-48ff-90f2-b6a819eb0b1f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:27.741042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1d4968d9-1f09-48ff-90f2-b6a819eb0b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:27.753036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4968d9-1f09-48ff-90f2-b6a819eb0b1f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:27.757717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:27.758585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:27.762732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:27.762732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] PATH_INFO: `/v3/users/e5e09a0387f54b3cb6f08ac341e47a93` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:27.762732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e09a0387f54b3cb6f08ac341e47a93)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:27.762732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:27.822407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c72ff79bb364f0d9bc9d9397abd5318', 'request_id': 'req-dfc18fd6-ada8-4c75-90a3-764b0734317c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.829498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c72ff79bb364f0d9bc9d9397abd5318', 'request_id': 'req-dfc18fd6-ada8-4c75-90a3-764b0734317c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.839381 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c72ff79bb364f0d9bc9d9397abd5318', 'request_id': 'req-dfc18fd6-ada8-4c75-90a3-764b0734317c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.927718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] The token cache is being invalidate because project 7c72ff79bb364f0d9bc9d9397abd5318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:27.928060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.928755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dfc18fd6-ada8-4c75-90a3-764b0734317c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.931037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 991/1993] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:27 2022] DELETE /identity/v3/projects/7c72ff79bb364f0d9bc9d9397abd5318 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:27.932147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce508974-c3bd-4e07-b0cf-e93c8a145bbb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:27.932445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce508974-c3bd-4e07-b0cf-e93c8a145bbb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:27.936035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce508974-c3bd-4e07-b0cf-e93c8a145bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:27.947278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e09a0387f54b3cb6f08ac341e47a93'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:27.953257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ce508974-c3bd-4e07-b0cf-e93c8a145bbb None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:27.954493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ce508974-c3bd-4e07-b0cf-e93c8a145bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:27.954908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e09a0387f54b3cb6f08ac341e47a93'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.011572 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 992/1994] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:28.013459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cc9b-33ad-4731-8b17-a0bb443eec4b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.014035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cc9b-33ad-4731-8b17-a0bb443eec4b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.014035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6cc9b-33ad-4731-8b17-a0bb443eec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.022336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:28.023818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e09a0387f54b3cb6f08ac341e47a93'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.029236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e09a0387f54b3cb6f08ac341e47a93'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.032162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fef6cc9b-33ad-4731-8b17-a0bb443eec4b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:28.033369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fef6cc9b-33ad-4731-8b17-a0bb443eec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.041922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 993/1995] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:28.043013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6cc9b-33ad-4731-8b17-a0bb443eec4b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.052319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6cc9b-33ad-4731-8b17-a0bb443eec4b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.058620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3293fb6-399f-4e7c-81e6-b7a37a096353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.058758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e09a0387f54b3cb6f08ac341e47a93'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.059338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293fb6-399f-4e7c-81e6-b7a37a096353 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.060542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293fb6-399f-4e7c-81e6-b7a37a096353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.060835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293fb6-399f-4e7c-81e6-b7a37a096353 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.061585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3293fb6-399f-4e7c-81e6-b7a37a096353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:28.061891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3293fb6-399f-4e7c-81e6-b7a37a096353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.063524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3293fb6-399f-4e7c-81e6-b7a37a096353 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.065468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1003/1996] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:27 2022] DELETE /identity/v3/users/e5e09a0387f54b3cb6f08ac341e47a93 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:28.069340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.071005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.078826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 994/1997] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:28.083699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e56065-a421-4646-ba62-18120a3bb927 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.083699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e56065-a421-4646-ba62-18120a3bb927 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.083699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e56065-a421-4646-ba62-18120a3bb927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.105080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-11e56065-a421-4646-ba62-18120a3bb927 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:28.106851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11e56065-a421-4646-ba62-18120a3bb927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.151120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94728f-8bae-46a6-87c1-8d209e2a9dde admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.157892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.158547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.158936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.159318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] PATH_INFO: `/v3/projects/cb379301a736420592f74683efcc4607` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.160896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb379301a736420592f74683efcc4607)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.162945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.171433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 995/1998] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:28.175671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e56065-a421-4646-ba62-18120a3bb927 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.175671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11e56065-a421-4646-ba62-18120a3bb927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.186046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e56065-a421-4646-ba62-18120a3bb927 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.190984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f8191-d688-42df-ae68-9be1440779bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.191977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8191-d688-42df-ae68-9be1440779bc admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.192305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8191-d688-42df-ae68-9be1440779bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.192586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f8191-d688-42df-ae68-9be1440779bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.193401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f8191-d688-42df-ae68-9be1440779bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.195344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f8191-d688-42df-ae68-9be1440779bc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.217137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:28.264890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb379301a736420592f74683efcc4607', 'request_id': 'req-4eecc7b0-1916-40dc-9d82-29206dcb547b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.271060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 996/1999] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:28.272036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb379301a736420592f74683efcc4607', 'request_id': 'req-4eecc7b0-1916-40dc-9d82-29206dcb547b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.276283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f8191-d688-42df-ae68-9be1440779bc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.281088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb379301a736420592f74683efcc4607', 'request_id': 'req-4eecc7b0-1916-40dc-9d82-29206dcb547b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.340997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f8191-d688-42df-ae68-9be1440779bc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.346366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.347466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.347466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.347643 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.348364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:28.348605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.350203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.362997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 997/2000] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:28.363829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.368455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] The token cache is being invalidate because project cb379301a736420592f74683efcc4607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:28.368850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.369524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.371502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1004/2001] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:28 2022] DELETE /identity/v3/projects/cb379301a736420592f74683efcc4607 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:28.373652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.376877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.384350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75354e9-b788-409f-8fb5-0d6fafb5c15b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.384587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f618a8c-990a-492f-9232-c6cb18064501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.385361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f618a8c-990a-492f-9232-c6cb18064501 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.385900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f618a8c-990a-492f-9232-c6cb18064501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.386177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f618a8c-990a-492f-9232-c6cb18064501 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.386865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f618a8c-990a-492f-9232-c6cb18064501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.389377 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f618a8c-990a-492f-9232-c6cb18064501 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.445967 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc7b0-1916-40dc-9d82-29206dcb547b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.452655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde481f3-4d35-43f6-b540-b795a2437517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.453329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde481f3-4d35-43f6-b540-b795a2437517 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.453615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde481f3-4d35-43f6-b540-b795a2437517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.453892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde481f3-4d35-43f6-b540-b795a2437517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.454589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde481f3-4d35-43f6-b540-b795a2437517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.457059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde481f3-4d35-43f6-b540-b795a2437517 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.515252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 998/2002] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:28.516668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d21db-1667-40d7-80b6-10e696ed51f8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.516958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d21db-1667-40d7-80b6-10e696ed51f8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.517243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d21db-1667-40d7-80b6-10e696ed51f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.536750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6c9d21db-1667-40d7-80b6-10e696ed51f8 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:28.537974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6c9d21db-1667-40d7-80b6-10e696ed51f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.550297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 999/2003] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:28.551188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d21db-1667-40d7-80b6-10e696ed51f8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.557030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6c9d21db-1667-40d7-80b6-10e696ed51f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.567062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1005/2004] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:28.568708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2f561-dafd-40b5-864e-425c659e3da3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.569071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d21db-1667-40d7-80b6-10e696ed51f8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.569198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2f561-dafd-40b5-864e-425c659e3da3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.569479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2f561-dafd-40b5-864e-425c659e3da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.587367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4bf2f561-dafd-40b5-864e-425c659e3da3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:28.588627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4bf2f561-dafd-40b5-864e-425c659e3da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.625328 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d42c-f5ab-411f-90a9-e31860d33299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.626649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d42c-f5ab-411f-90a9-e31860d33299 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.626949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d42c-f5ab-411f-90a9-e31860d33299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.627233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d42c-f5ab-411f-90a9-e31860d33299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.628002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8d42c-f5ab-411f-90a9-e31860d33299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.629648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8d42c-f5ab-411f-90a9-e31860d33299 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.642741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1000/2005] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:28.642741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d42c-f5ab-411f-90a9-e31860d33299 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.650714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1006/2006] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:28.654046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2f561-dafd-40b5-864e-425c659e3da3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.655169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d42c-f5ab-411f-90a9-e31860d33299 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.660426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74ff8d-1e6c-455f-b7e9-7f1f38cbecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.661106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ff8d-1e6c-455f-b7e9-7f1f38cbecbe admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.661388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ff8d-1e6c-455f-b7e9-7f1f38cbecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.661666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74ff8d-1e6c-455f-b7e9-7f1f38cbecbe admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.662488 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74ff8d-1e6c-455f-b7e9-7f1f38cbecbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.663321 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2f561-dafd-40b5-864e-425c659e3da3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.664465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74ff8d-1e6c-455f-b7e9-7f1f38cbecbe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.668878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.672126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.672126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.672126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.672126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.673337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.684076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1007/2007] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:28.685612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.687280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.699838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433fcbb-35b7-4c1d-8d1f-426401e262cb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.704749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.705253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.705546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.705828 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] PATH_INFO: `/v3/projects/5cce0d9c89224c1fb072a00343ee2f6d` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.706998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cce0d9c89224c1fb072a00343ee2f6d)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.708917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.752337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1001/2008] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/users => generated 282 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:28.753171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74ff8d-1e6c-455f-b7e9-7f1f38cbecbe admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.762756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74ff8d-1e6c-455f-b7e9-7f1f38cbecbe admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.771010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.771010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.771010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.771010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.771388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:28.771388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.771388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.784542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1002/2009] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:28.788320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.795770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f3b9-0338-4d0e-9aa6-de0f442c4e16 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.799988 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cce0d9c89224c1fb072a00343ee2f6d', 'request_id': 'req-3d2b7ef8-9135-40d9-be43-764c219e87fa'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.806782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cce0d9c89224c1fb072a00343ee2f6d', 'request_id': 'req-3d2b7ef8-9135-40d9-be43-764c219e87fa'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.814114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cce0d9c89224c1fb072a00343ee2f6d', 'request_id': 'req-3d2b7ef8-9135-40d9-be43-764c219e87fa'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.851790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.852699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.852979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.853252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] PATH_INFO: `/v3/projects/6acd0ca31ad647f68ecb0d439a2ca8a9/users/8f36b60e61ad4d8080450232160020f4/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.867340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acd0ca31ad647f68ecb0d439a2ca8a9, user_id=8f36b60e61ad4d8080450232160020f4, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.870038 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.879175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] The token cache is being invalidate because project 5cce0d9c89224c1fb072a00343ee2f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:28.879467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.880140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:28.881689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1008/2010] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:28 2022] DELETE /identity/v3/projects/5cce0d9c89224c1fb072a00343ee2f6d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:28.882533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.883941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.896403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b7ef8-9135-40d9-be43-764c219e87fa admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.902889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.903553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.903839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.904147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.904864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.906448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:28.915937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1009/2011] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:28.916841 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.918427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.930954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cd5d5-964a-4e93-8d7e-da18b043fd04 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:28.937612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1003/2012] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:28 2022] PUT /identity/v3/projects/6acd0ca31ad647f68ecb0d439a2ca8a9/users/8f36b60e61ad4d8080450232160020f4/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:28.938525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:28.940255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:28.987006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:28.988535 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10394389-9081-4a7e-b161-8a951596ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:28.989245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10394389-9081-4a7e-b161-8a951596ead0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:28.989528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10394389-9081-4a7e-b161-8a951596ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:28.989809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10394389-9081-4a7e-b161-8a951596ead0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:28.990533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10394389-9081-4a7e-b161-8a951596ead0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:28.992506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10394389-9081-4a7e-b161-8a951596ead0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.020132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a6fe-392e-4d43-a257-26ed0908ea4b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.031360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.031360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.031360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.031360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] PATH_INFO: `/v3/users/0946dc0ec7da4a7f8272feccf40de9ea` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.031746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0946dc0ec7da4a7f8272feccf40de9ea)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.031746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.086064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1010/2013] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:28 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:29.086891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10394389-9081-4a7e-b161-8a951596ead0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.136615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:29.146592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10394389-9081-4a7e-b161-8a951596ead0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.151307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d34e73-e341-47bb-bc80-53eb68e2baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.152019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d34e73-e341-47bb-bc80-53eb68e2baff admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.152305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d34e73-e341-47bb-bc80-53eb68e2baff admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.152582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d34e73-e341-47bb-bc80-53eb68e2baff admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.153306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d34e73-e341-47bb-bc80-53eb68e2baff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.155422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d34e73-e341-47bb-bc80-53eb68e2baff admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.165050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1011/2014] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:29.166359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b774f25-0837-499c-8495-a8a19449a62e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.166655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b774f25-0837-499c-8495-a8a19449a62e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.171274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b774f25-0837-499c-8495-a8a19449a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.192699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2b774f25-0837-499c-8495-a8a19449a62e None None] MFA Rules not processed for user `8f36b60e61ad4d8080450232160020f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:29.193899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2b774f25-0837-499c-8495-a8a19449a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:29.200796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0946dc0ec7da4a7f8272feccf40de9ea'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:29.256373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1012/2015] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:29.257322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b774f25-0837-499c-8495-a8a19449a62e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.267381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b774f25-0837-499c-8495-a8a19449a62e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.271211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0946dc0ec7da4a7f8272feccf40de9ea'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:29.271947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.272586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.272868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.273147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.273822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.275722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.289510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0946dc0ec7da4a7f8272feccf40de9ea'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:29.289510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0946dc0ec7da4a7f8272feccf40de9ea'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:29.292214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0946dc0ec7da4a7f8272feccf40de9ea'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:29.298824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1004/2016] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:28 2022] DELETE /identity/v3/users/0946dc0ec7da4a7f8272feccf40de9ea => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:29.299578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.300960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:29.368942 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1013/2017] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:29 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:29.369763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.371876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f653-8bec-4651-839e-be57c4394228 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.372721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:29.376616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86b4d-7ec4-43b6-8afe-a8fa823d57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.377489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86b4d-7ec4-43b6-8afe-a8fa823d57a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.377771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86b4d-7ec4-43b6-8afe-a8fa823d57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.378042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86b4d-7ec4-43b6-8afe-a8fa823d57a5 admin admin] PATH_INFO: `/v3/projects/ebe14d8779a2438eb427e58d739e316f/users/361a68d09c354194abe3a91f8dae656d/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.388608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bde01-a7aa-4519-8043-36ffb4701b70 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.393608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.394577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a86b4d-7ec4-43b6-8afe-a8fa823d57a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe14d8779a2438eb427e58d739e316f, user_id=361a68d09c354194abe3a91f8dae656d, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.394684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.394684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.395153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.396102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.396687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a86b4d-7ec4-43b6-8afe-a8fa823d57a5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.398129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.508207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1014/2018] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:29 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:29.508592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1005/2019] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:29 2022] PUT /identity/v3/projects/ebe14d8779a2438eb427e58d739e316f/users/361a68d09c354194abe3a91f8dae656d/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:29.509557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.516225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:29.516972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86b4d-7ec4-43b6-8afe-a8fa823d57a5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.589905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:29.595013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380eef95-8f11-4e78-9e79-d38001964ddf admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.601118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248c77d-bd46-4d0b-be7c-74f63ac54aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.601819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c77d-bd46-4d0b-be7c-74f63ac54aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.602086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c77d-bd46-4d0b-be7c-74f63ac54aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.602360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c77d-bd46-4d0b-be7c-74f63ac54aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.603099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c77d-bd46-4d0b-be7c-74f63ac54aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.605031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c77d-bd46-4d0b-be7c-74f63ac54aa4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.618196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1015/2020] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:29.619865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19e82-151b-4bf7-ae58-cb7b2d9c8c2f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.620178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19e82-151b-4bf7-ae58-cb7b2d9c8c2f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.620462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19e82-151b-4bf7-ae58-cb7b2d9c8c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.641954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86b4d-7ec4-43b6-8afe-a8fa823d57a5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.647889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02135a-8ead-48df-90ff-31b0c965c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.648897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02135a-8ead-48df-90ff-31b0c965c076 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.649396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02135a-8ead-48df-90ff-31b0c965c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.649908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02135a-8ead-48df-90ff-31b0c965c076 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.650959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02135a-8ead-48df-90ff-31b0c965c076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.651709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cfa19e82-151b-4bf7-ae58-cb7b2d9c8c2f None None] MFA Rules not processed for user `361a68d09c354194abe3a91f8dae656d`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:29.653131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cfa19e82-151b-4bf7-ae58-cb7b2d9c8c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:29.656159 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02135a-8ead-48df-90ff-31b0c965c076 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.683378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:29.741614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1016/2021] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:29.742497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa19e82-151b-4bf7-ae58-cb7b2d9c8c2f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.754177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa19e82-151b-4bf7-ae58-cb7b2d9c8c2f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.761097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1006/2022] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:29 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:29.761097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02135a-8ead-48df-90ff-31b0c965c076 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.763929 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758acd-0a60-4862-a452-78201aa24e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.764652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758acd-0a60-4862-a452-78201aa24e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.765090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758acd-0a60-4862-a452-78201aa24e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.765429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758acd-0a60-4862-a452-78201aa24e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.766234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12758acd-0a60-4862-a452-78201aa24e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.768063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12758acd-0a60-4862-a452-78201aa24e45 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.770738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02135a-8ead-48df-90ff-31b0c965c076 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.776265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.776991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.777273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.777552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.778241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.779554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1017/2023] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:29.780430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758acd-0a60-4862-a452-78201aa24e45 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.783386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.790264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758acd-0a60-4862-a452-78201aa24e45 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.799109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c071a5d-d33d-4f2b-a364-052c37303e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.799791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071a5d-d33d-4f2b-a364-052c37303e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.800052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071a5d-d33d-4f2b-a364-052c37303e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.800324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071a5d-d33d-4f2b-a364-052c37303e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.801043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c071a5d-d33d-4f2b-a364-052c37303e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.802680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c071a5d-d33d-4f2b-a364-052c37303e1a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.815072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1018/2024] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:29.816038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c071a5d-d33d-4f2b-a364-052c37303e1a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.828570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c071a5d-d33d-4f2b-a364-052c37303e1a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.833719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40160e1-3738-4b9e-b3d9-556d6e485046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:29.834595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40160e1-3738-4b9e-b3d9-556d6e485046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:29.834918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40160e1-3738-4b9e-b3d9-556d6e485046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:29.835146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40160e1-3738-4b9e-b3d9-556d6e485046 admin admin] PATH_INFO: `/v3/projects/f488525d2b2d48e492a1cd2e7b87fe5b/users/388dfbbff9fb42f0b4200532359d6508/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:29.850689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40160e1-3738-4b9e-b3d9-556d6e485046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f488525d2b2d48e492a1cd2e7b87fe5b, user_id=388dfbbff9fb42f0b4200532359d6508, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:29.853452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40160e1-3738-4b9e-b3d9-556d6e485046 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:29.875223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1007/2025] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:29 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:29.876094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:29.877676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:29.944127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa4fcd-55da-4193-8a33-13a369008f36 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:29.947599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1019/2026] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:29 2022] PUT /identity/v3/projects/f488525d2b2d48e492a1cd2e7b87fe5b/users/388dfbbff9fb42f0b4200532359d6508/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:29.958012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40160e1-3738-4b9e-b3d9-556d6e485046 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.005345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.006224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.006503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.006778 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] PATH_INFO: `/v3/projects/fd93698d769d458b9ac824fbe0bfc731` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.008010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd93698d769d458b9ac824fbe0bfc731)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.009952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.034683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40160e1-3738-4b9e-b3d9-556d6e485046 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.040167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd211b13-c202-4aa2-9c1a-97c60ba09c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.041227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211b13-c202-4aa2-9c1a-97c60ba09c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.041612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211b13-c202-4aa2-9c1a-97c60ba09c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.041994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211b13-c202-4aa2-9c1a-97c60ba09c70 admin admin] PATH_INFO: `/v3/projects/a096d63a070f45d6b87a49a285abdf3f/users/dc3b9f10f80241e68e1a878d804c751f/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.056587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd211b13-c202-4aa2-9c1a-97c60ba09c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a096d63a070f45d6b87a49a285abdf3f, user_id=dc3b9f10f80241e68e1a878d804c751f, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.059329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd211b13-c202-4aa2-9c1a-97c60ba09c70 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.153361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1020/2027] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:29 2022] PUT /identity/v3/projects/a096d63a070f45d6b87a49a285abdf3f/users/dc3b9f10f80241e68e1a878d804c751f/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:30.154373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd211b13-c202-4aa2-9c1a-97c60ba09c70 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.160743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd93698d769d458b9ac824fbe0bfc731', 'request_id': 'req-9902bd25-2f77-453a-92b7-e92cbb6f76c5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:30.166372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd93698d769d458b9ac824fbe0bfc731', 'request_id': 'req-9902bd25-2f77-453a-92b7-e92cbb6f76c5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:30.173109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd93698d769d458b9ac824fbe0bfc731', 'request_id': 'req-9902bd25-2f77-453a-92b7-e92cbb6f76c5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:30.198257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:30.218026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd211b13-c202-4aa2-9c1a-97c60ba09c70 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.222651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.223309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.223586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.223934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.224621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.227288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.259022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] The token cache is being invalidate because project fd93698d769d458b9ac824fbe0bfc731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:30.259315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:30.259989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9902bd25-2f77-453a-92b7-e92cbb6f76c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:30.261862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1008/2028] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:29 2022] DELETE /identity/v3/projects/fd93698d769d458b9ac824fbe0bfc731 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:30.263287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb1f2-3d07-464b-8cb0-df3040585f7a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.263555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb1f2-3d07-464b-8cb0-df3040585f7a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.263836 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb1f2-3d07-464b-8cb0-df3040585f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.285433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:30.293297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-265cb1f2-3d07-464b-8cb0-df3040585f7a None None] MFA Rules not processed for user `388dfbbff9fb42f0b4200532359d6508`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:30.295085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-265cb1f2-3d07-464b-8cb0-df3040585f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.348651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1021/2029] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:30 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:30.348651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.348651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.360112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3e611-2f44-42b4-9f8c-9a4e1fa1bfd3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.365921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1009/2030] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:30.365921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d6332-c23f-4a42-8a6a-4692f55a9a96 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.365921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d6332-c23f-4a42-8a6a-4692f55a9a96 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.365921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d6332-c23f-4a42-8a6a-4692f55a9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.368180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.368849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.369134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.369410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.370139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.371733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.382621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1022/2031] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:30.383683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.384345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-461d6332-c23f-4a42-8a6a-4692f55a9a96 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:30.385969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-461d6332-c23f-4a42-8a6a-4692f55a9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.386449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.394023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1010/2032] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:30.394853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d6332-c23f-4a42-8a6a-4692f55a9a96 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.396261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-461d6332-c23f-4a42-8a6a-4692f55a9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.399020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3865d9-6aa9-44cf-81b9-0cdaf099af16 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.404978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1225-12bb-418b-b756-1892682495be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.405684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1225-12bb-418b-b756-1892682495be admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.405926 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1225-12bb-418b-b756-1892682495be admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.406209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1225-12bb-418b-b756-1892682495be admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.406938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff1225-12bb-418b-b756-1892682495be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.408575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff1225-12bb-418b-b756-1892682495be admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.410149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d6332-c23f-4a42-8a6a-4692f55a9a96 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.415091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c178bf-72cb-49dc-9d0a-fa8e4b5ea050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.415756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c178bf-72cb-49dc-9d0a-fa8e4b5ea050 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.416077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c178bf-72cb-49dc-9d0a-fa8e4b5ea050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.423571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c178bf-72cb-49dc-9d0a-fa8e4b5ea050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.423571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c178bf-72cb-49dc-9d0a-fa8e4b5ea050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.423571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c178bf-72cb-49dc-9d0a-fa8e4b5ea050 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.423820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1023/2033] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:30.423820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1225-12bb-418b-b756-1892682495be admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.430629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1225-12bb-418b-b756-1892682495be admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.436224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37897b2-8d8a-4ed4-91af-66f6ee333261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.437092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37897b2-8d8a-4ed4-91af-66f6ee333261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.437377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37897b2-8d8a-4ed4-91af-66f6ee333261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.437652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37897b2-8d8a-4ed4-91af-66f6ee333261 admin admin] PATH_INFO: `/v3/projects/a096d63a070f45d6b87a49a285abdf3f/users/dc3b9f10f80241e68e1a878d804c751f/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.439621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37897b2-8d8a-4ed4-91af-66f6ee333261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a096d63a070f45d6b87a49a285abdf3f, user_id=dc3b9f10f80241e68e1a878d804c751f, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.442329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37897b2-8d8a-4ed4-91af-66f6ee333261 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.452484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1024/2034] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:30 2022] PUT /identity/v3/projects/a096d63a070f45d6b87a49a285abdf3f/users/dc3b9f10f80241e68e1a878d804c751f/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:30.453654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2481b-694c-4734-b8b0-e3f622fafc12 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.453946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2481b-694c-4734-b8b0-e3f622fafc12 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.454277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2481b-694c-4734-b8b0-e3f622fafc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.471949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0ee2481b-694c-4734-b8b0-e3f622fafc12 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:30.473142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0ee2481b-694c-4734-b8b0-e3f622fafc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.513193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1011/2035] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:30 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:30.514142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c178bf-72cb-49dc-9d0a-fa8e4b5ea050 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.532087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1025/2036] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:30.533606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc17f87-26d8-4371-aa67-ba3bcd0c0bb2 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.533891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc17f87-26d8-4371-aa67-ba3bcd0c0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.534175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc17f87-26d8-4371-aa67-ba3bcd0c0bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.560297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7bc17f87-26d8-4371-aa67-ba3bcd0c0bb2 None None] MFA Rules not processed for user `dc3b9f10f80241e68e1a878d804c751f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:30.561538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7bc17f87-26d8-4371-aa67-ba3bcd0c0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.577135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c178bf-72cb-49dc-9d0a-fa8e4b5ea050 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.582111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ce55e-3798-4c92-868f-e731567c278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.582991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ce55e-3798-4c92-868f-e731567c278c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.583274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ce55e-3798-4c92-868f-e731567c278c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.595009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ce55e-3798-4c92-868f-e731567c278c admin admin] PATH_INFO: `/v3/projects/6f56669fcf3346559733d6cfd3f56803/users/3282e050b1a74527b2b10c98055a9e27/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.598153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ce55e-3798-4c92-868f-e731567c278c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f56669fcf3346559733d6cfd3f56803, user_id=3282e050b1a74527b2b10c98055a9e27, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.600923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ce55e-3798-4c92-868f-e731567c278c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.631206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1026/2037] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:30.632058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc17f87-26d8-4371-aa67-ba3bcd0c0bb2 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.642058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc17f87-26d8-4371-aa67-ba3bcd0c0bb2 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.646754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da2d2c-b24b-45ad-98dd-e0f7459af50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.647400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2d2c-b24b-45ad-98dd-e0f7459af50c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.647680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2d2c-b24b-45ad-98dd-e0f7459af50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.647987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2d2c-b24b-45ad-98dd-e0f7459af50c admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.648704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da2d2c-b24b-45ad-98dd-e0f7459af50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.650629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da2d2c-b24b-45ad-98dd-e0f7459af50c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.702376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1012/2038] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:30 2022] PUT /identity/v3/projects/6f56669fcf3346559733d6cfd3f56803/users/3282e050b1a74527b2b10c98055a9e27/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:30.703373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ce55e-3798-4c92-868f-e731567c278c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.745046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:30.785912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ce55e-3798-4c92-868f-e731567c278c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.790823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.791493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.791776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.792112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.792838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:30.793143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.795288 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.810789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1013/2039] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:30.811696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.815880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1027/2040] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:30 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:30.816169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.816270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da2d2c-b24b-45ad-98dd-e0f7459af50c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.826871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da2d2c-b24b-45ad-98dd-e0f7459af50c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.832367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39a3b-bb42-4507-ad1a-9621e4cb9985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.833643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39a3b-bb42-4507-ad1a-9621e4cb9985 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.834295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39a3b-bb42-4507-ad1a-9621e4cb9985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.834795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39a3b-bb42-4507-ad1a-9621e4cb9985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.836782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:30.838202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39a3b-bb42-4507-ad1a-9621e4cb9985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.839941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39a3b-bb42-4507-ad1a-9621e4cb9985 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.853053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1028/2041] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:30.853816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39a3b-bb42-4507-ad1a-9621e4cb9985 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.865790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39a3b-bb42-4507-ad1a-9621e4cb9985 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.871088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce9f41-f4bc-49be-8031-7426f1c1315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.871744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce9f41-f4bc-49be-8031-7426f1c1315a admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.872230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce9f41-f4bc-49be-8031-7426f1c1315a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.872508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce9f41-f4bc-49be-8031-7426f1c1315a admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.873201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce9f41-f4bc-49be-8031-7426f1c1315a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.875102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce9f41-f4bc-49be-8031-7426f1c1315a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.889668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352dd6f-6fce-4723-b812-dec3290005a1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.893695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.894457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.894842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.895272 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.898295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:30.964595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.966606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:30.977294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1014/2042] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:30.978032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:30.989586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbaa4e-e0ff-482d-85fa-7fe2b7f58673 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:30.994401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c2ba-4a2b-4cb6-a90c-71973d1a0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:30.995080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c2ba-4a2b-4cb6-a90c-71973d1a0b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:30.995386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c2ba-4a2b-4cb6-a90c-71973d1a0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:30.995686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c2ba-4a2b-4cb6-a90c-71973d1a0b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:30.996572 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0c2ba-4a2b-4cb6-a90c-71973d1a0b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:30.998211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0c2ba-4a2b-4cb6-a90c-71973d1a0b0b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.013727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1015/2043] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:31.013727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c2ba-4a2b-4cb6-a90c-71973d1a0b0b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.024118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c2ba-4a2b-4cb6-a90c-71973d1a0b0b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.029670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40a6f-6270-4fb2-a411-ce94ca90ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.030106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1029/2044] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:30 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:31.076046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40a6f-6270-4fb2-a411-ce94ca90ac42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.076046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40a6f-6270-4fb2-a411-ce94ca90ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.076046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab40a6f-6270-4fb2-a411-ce94ca90ac42 admin admin] PATH_INFO: `/v3/projects/6f56669fcf3346559733d6cfd3f56803/users/3282e050b1a74527b2b10c98055a9e27/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.076557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce9f41-f4bc-49be-8031-7426f1c1315a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.076634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40a6f-6270-4fb2-a411-ce94ca90ac42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f56669fcf3346559733d6cfd3f56803, user_id=3282e050b1a74527b2b10c98055a9e27, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.076634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab40a6f-6270-4fb2-a411-ce94ca90ac42 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.076634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1016/2045] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:31 2022] PUT /identity/v3/projects/6f56669fcf3346559733d6cfd3f56803/users/3282e050b1a74527b2b10c98055a9e27/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:31.085742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40a6f-6270-4fb2-a411-ce94ca90ac42 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.111950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce9f41-f4bc-49be-8031-7426f1c1315a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.194914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f24e5-cdf8-4b4c-9677-827d3d972043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.195808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f24e5-cdf8-4b4c-9677-827d3d972043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.196823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f24e5-cdf8-4b4c-9677-827d3d972043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.196823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f24e5-cdf8-4b4c-9677-827d3d972043 admin admin] PATH_INFO: `/v3/projects/0e2b501e00ff42ea9c06c29f5ae9c2f5/users/048eff3e29554e2b9a14d4d03f3d0287/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.204948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab40a6f-6270-4fb2-a411-ce94ca90ac42 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.210044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095904b-1e00-4f6a-9ade-ff34e37c5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.210970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095904b-1e00-4f6a-9ade-ff34e37c5be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.211110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095904b-1e00-4f6a-9ade-ff34e37c5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.211469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095904b-1e00-4f6a-9ade-ff34e37c5be7 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.212289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095904b-1e00-4f6a-9ade-ff34e37c5be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.213343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f24e5-cdf8-4b4c-9677-827d3d972043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2b501e00ff42ea9c06c29f5ae9c2f5, user_id=048eff3e29554e2b9a14d4d03f3d0287, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.214392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095904b-1e00-4f6a-9ade-ff34e37c5be7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.217725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f24e5-cdf8-4b4c-9677-827d3d972043 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.426056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1030/2046] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:31 2022] PUT /identity/v3/projects/0e2b501e00ff42ea9c06c29f5ae9c2f5/users/048eff3e29554e2b9a14d4d03f3d0287/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:31.427539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aad92d-0f55-4fdb-9c04-395e2bf6b78c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.427833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aad92d-0f55-4fdb-9c04-395e2bf6b78c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.428199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aad92d-0f55-4fdb-9c04-395e2bf6b78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.432777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1017/2047] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:31 2022] POST /identity/v3/users => generated 294 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:31.432777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095904b-1e00-4f6a-9ade-ff34e37c5be7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.442894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095904b-1e00-4f6a-9ade-ff34e37c5be7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.455606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-10aad92d-0f55-4fdb-9c04-395e2bf6b78c None None] MFA Rules not processed for user `3282e050b1a74527b2b10c98055a9e27`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:31.456826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-10aad92d-0f55-4fdb-9c04-395e2bf6b78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:31.499216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fac18-b9c6-4144-880a-6dce31927a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.499977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fac18-b9c6-4144-880a-6dce31927a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.500759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fac18-b9c6-4144-880a-6dce31927a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.500759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fac18-b9c6-4144-880a-6dce31927a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.501250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fac18-b9c6-4144-880a-6dce31927a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.502851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fac18-b9c6-4144-880a-6dce31927a56 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.513851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1018/2048] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:31.514818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fac18-b9c6-4144-880a-6dce31927a56 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.525919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1031/2049] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:31.526726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aad92d-0f55-4fdb-9c04-395e2bf6b78c None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.527217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fac18-b9c6-4144-880a-6dce31927a56 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.534656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5d864-5f83-4737-8bac-08c789eb83a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.535330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d864-5f83-4737-8bac-08c789eb83a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.535618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d864-5f83-4737-8bac-08c789eb83a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.535920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d864-5f83-4737-8bac-08c789eb83a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.536748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d864-5f83-4737-8bac-08c789eb83a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.537563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aad92d-0f55-4fdb-9c04-395e2bf6b78c None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.538495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d864-5f83-4737-8bac-08c789eb83a3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.542480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922ab0-49b8-42e6-a1c1-6a8b1824fd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.545473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922ab0-49b8-42e6-a1c1-6a8b1824fd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.545473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922ab0-49b8-42e6-a1c1-6a8b1824fd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.545473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922ab0-49b8-42e6-a1c1-6a8b1824fd64 admin admin] PATH_INFO: `/v3/projects/0e2b501e00ff42ea9c06c29f5ae9c2f5/users/048eff3e29554e2b9a14d4d03f3d0287/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.546712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922ab0-49b8-42e6-a1c1-6a8b1824fd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2b501e00ff42ea9c06c29f5ae9c2f5, user_id=048eff3e29554e2b9a14d4d03f3d0287, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.552084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1019/2050] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:31.552247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922ab0-49b8-42e6-a1c1-6a8b1824fd64 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.552349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5d864-5f83-4737-8bac-08c789eb83a3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.561547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1032/2051] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:31 2022] PUT /identity/v3/projects/0e2b501e00ff42ea9c06c29f5ae9c2f5/users/048eff3e29554e2b9a14d4d03f3d0287/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:31.562328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922ab0-49b8-42e6-a1c1-6a8b1824fd64 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.608241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5d864-5f83-4737-8bac-08c789eb83a3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.637594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922ab0-49b8-42e6-a1c1-6a8b1824fd64 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.641133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f028d-9a44-4582-8eac-f9ce2a071420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.641940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f028d-9a44-4582-8eac-f9ce2a071420 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.642227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f028d-9a44-4582-8eac-f9ce2a071420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.642497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f028d-9a44-4582-8eac-f9ce2a071420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.643322 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f028d-9a44-4582-8eac-f9ce2a071420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.644991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f028d-9a44-4582-8eac-f9ce2a071420 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.655500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1033/2052] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:31.656796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c2a6-9233-45d7-9e01-db2cc94bdf21 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.660522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c2a6-9233-45d7-9e01-db2cc94bdf21 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.660522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c2a6-9233-45d7-9e01-db2cc94bdf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.660735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa169b-512a-4b88-a29c-c5e8634deaa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.660735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa169b-512a-4b88-a29c-c5e8634deaa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.661042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa169b-512a-4b88-a29c-c5e8634deaa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.661334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa169b-512a-4b88-a29c-c5e8634deaa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.684063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8c07c2a6-9233-45d7-9e01-db2cc94bdf21 None None] MFA Rules not processed for user `048eff3e29554e2b9a14d4d03f3d0287`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:31.686005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8c07c2a6-9233-45d7-9e01-db2cc94bdf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:31.724697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa169b-512a-4b88-a29c-c5e8634deaa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.726145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa169b-512a-4b88-a29c-c5e8634deaa8 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.737459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1020/2053] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:31.738523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa169b-512a-4b88-a29c-c5e8634deaa8 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.752708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa169b-512a-4b88-a29c-c5e8634deaa8 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.757214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30bceb-dcb0-4ba0-ac0d-38bcc6b3cdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.759006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30bceb-dcb0-4ba0-ac0d-38bcc6b3cdac admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.759494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30bceb-dcb0-4ba0-ac0d-38bcc6b3cdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.759779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30bceb-dcb0-4ba0-ac0d-38bcc6b3cdac admin admin] PATH_INFO: `/v3/projects/5c7332e285704f37aea334dc8d1ea1b4/users/23ada718f4b94dc9bccca85315d57ae5/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.767375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1034/2054] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:31.775516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30bceb-dcb0-4ba0-ac0d-38bcc6b3cdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7332e285704f37aea334dc8d1ea1b4, user_id=23ada718f4b94dc9bccca85315d57ae5, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.778363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30bceb-dcb0-4ba0-ac0d-38bcc6b3cdac admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.841940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07c2a6-9233-45d7-9e01-db2cc94bdf21 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.855194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07c2a6-9233-45d7-9e01-db2cc94bdf21 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:31.859417 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662405a-2c7f-4ec4-b4ed-69c140dd894a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:31.860088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662405a-2c7f-4ec4-b4ed-69c140dd894a service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.866986 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662405a-2c7f-4ec4-b4ed-69c140dd894a service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.866986 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662405a-2c7f-4ec4-b4ed-69c140dd894a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.867256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1021/2055] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:31 2022] PUT /identity/v3/projects/5c7332e285704f37aea334dc8d1ea1b4/users/23ada718f4b94dc9bccca85315d57ae5/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:31.873383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662405a-2c7f-4ec4-b4ed-69c140dd894a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:31.874823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662405a-2c7f-4ec4-b4ed-69c140dd894a service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:31.877592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d010-b19a-4f67-afc4-6ecf5ec5ff61 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:31.877927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d010-b19a-4f67-afc4-6ecf5ec5ff61 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:31.878210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5d010-b19a-4f67-afc4-6ecf5ec5ff61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:31.884465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1035/2056] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:31.904969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-18f5d010-b19a-4f67-afc4-6ecf5ec5ff61 None None] MFA Rules not processed for user `23ada718f4b94dc9bccca85315d57ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:31.906168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-18f5d010-b19a-4f67-afc4-6ecf5ec5ff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:31.981181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662405a-2c7f-4ec4-b4ed-69c140dd894a service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:31.983080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:31.990971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1022/2057] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:32.003181 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d010-b19a-4f67-afc4-6ecf5ec5ff61 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:32.004253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662405a-2c7f-4ec4-b4ed-69c140dd894a service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:32.093275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5d010-b19a-4f67-afc4-6ecf5ec5ff61 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:32.098335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:32.098986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:32.099269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:32.099538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:32.103234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dff116-d710-45ab-ae1c-22a1710fa84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:32.103990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dff116-d710-45ab-ae1c-22a1710fa84e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:32.104338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dff116-d710-45ab-ae1c-22a1710fa84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:32.104680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dff116-d710-45ab-ae1c-22a1710fa84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:32.105485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dff116-d710-45ab-ae1c-22a1710fa84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:32.108083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dff116-d710-45ab-ae1c-22a1710fa84e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:32.111096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:32.172178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:32.173916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:32.184023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1023/2058] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:32.215743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1036/2059] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:31 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:32.216860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:32.228944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3bb1a-7c32-4b75-8ab2-f895336ba5bf service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:32.234609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:32.306417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88677d8-ada8-4251-9871-d3ba38850b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:32.307491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88677d8-ada8-4251-9871-d3ba38850b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:32.309025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88677d8-ada8-4251-9871-d3ba38850b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:32.309372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88677d8-ada8-4251-9871-d3ba38850b30 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:32.311828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88677d8-ada8-4251-9871-d3ba38850b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:32.316417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88677d8-ada8-4251-9871-d3ba38850b30 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:32.480355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1024/2060] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:32 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:32.490396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dff116-d710-45ab-ae1c-22a1710fa84e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:32.500652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dff116-d710-45ab-ae1c-22a1710fa84e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:32.505189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a1037-372c-4d2c-a207-bef465480c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:32.506127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1037-372c-4d2c-a207-bef465480c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:32.506258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1037-372c-4d2c-a207-bef465480c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:32.506621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1037-372c-4d2c-a207-bef465480c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:32.507380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a1037-372c-4d2c-a207-bef465480c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:32.508978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a1037-372c-4d2c-a207-bef465480c2a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:32.520801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1037/2061] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:32.524914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88677d8-ada8-4251-9871-d3ba38850b30 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:32.535640 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88677d8-ada8-4251-9871-d3ba38850b30 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:32.540347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aac76-f4d8-4a8e-a395-72b562e9b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:32.541222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aac76-f4d8-4a8e-a395-72b562e9b2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:32.541501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aac76-f4d8-4a8e-a395-72b562e9b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:32.541771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2aac76-f4d8-4a8e-a395-72b562e9b2f6 admin admin] PATH_INFO: `/v3/projects/a8cb8cc5e0f74f4991187e0892e789eb/users/cab2f6cf5b644f13b075fa6775dd25e4/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:32.557221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aac76-f4d8-4a8e-a395-72b562e9b2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8cb8cc5e0f74f4991187e0892e789eb, user_id=cab2f6cf5b644f13b075fa6775dd25e4, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:32.560130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2aac76-f4d8-4a8e-a395-72b562e9b2f6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:32.700964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a1037-372c-4d2c-a207-bef465480c2a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:32.701389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1025/2062] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:32 2022] PUT /identity/v3/projects/a8cb8cc5e0f74f4991187e0892e789eb/users/cab2f6cf5b644f13b075fa6775dd25e4/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:32.711506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a1037-372c-4d2c-a207-bef465480c2a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:32.809413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af1665-0888-41c5-9944-1e8452c8a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:32.810568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1665-0888-41c5-9944-1e8452c8a1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:32.810845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1665-0888-41c5-9944-1e8452c8a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:32.811115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af1665-0888-41c5-9944-1e8452c8a1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:32.811840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af1665-0888-41c5-9944-1e8452c8a1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:32.813455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af1665-0888-41c5-9944-1e8452c8a1a0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:32.823572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1038/2063] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:32.829200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aac76-f4d8-4a8e-a395-72b562e9b2f6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:32.840709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2aac76-f4d8-4a8e-a395-72b562e9b2f6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:32.845512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181ae2d-3392-43c2-95aa-ff55b3a6d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:32.846586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ae2d-3392-43c2-95aa-ff55b3a6d8df admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:32.846907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ae2d-3392-43c2-95aa-ff55b3a6d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:32.847331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181ae2d-3392-43c2-95aa-ff55b3a6d8df admin admin] PATH_INFO: `/v3/projects/a8cb8cc5e0f74f4991187e0892e789eb/users/cab2f6cf5b644f13b075fa6775dd25e4/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:32.849402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181ae2d-3392-43c2-95aa-ff55b3a6d8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8cb8cc5e0f74f4991187e0892e789eb, user_id=cab2f6cf5b644f13b075fa6775dd25e4, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:32.852086 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181ae2d-3392-43c2-95aa-ff55b3a6d8df admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:32.862758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1026/2064] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:32 2022] PUT /identity/v3/projects/a8cb8cc5e0f74f4991187e0892e789eb/users/cab2f6cf5b644f13b075fa6775dd25e4/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:32.874444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66796a-3123-42b0-b843-be4a8efb66c8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:32.874733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66796a-3123-42b0-b843-be4a8efb66c8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:32.875014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66796a-3123-42b0-b843-be4a8efb66c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:32.904799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ac66796a-3123-42b0-b843-be4a8efb66c8 None None] MFA Rules not processed for user `cab2f6cf5b644f13b075fa6775dd25e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:32.904799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ac66796a-3123-42b0-b843-be4a8efb66c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:32.975017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1039/2065] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:32.986105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181ae2d-3392-43c2-95aa-ff55b3a6d8df admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:33.041089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181ae2d-3392-43c2-95aa-ff55b3a6d8df admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:33.044850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20ac6-2cfa-4cea-bc23-3b8cafb5d0b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:33.045484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20ac6-2cfa-4cea-bc23-3b8cafb5d0b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:33.045762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20ac6-2cfa-4cea-bc23-3b8cafb5d0b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:33.046033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20ac6-2cfa-4cea-bc23-3b8cafb5d0b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:33.054946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20ac6-2cfa-4cea-bc23-3b8cafb5d0b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:33.056386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20ac6-2cfa-4cea-bc23-3b8cafb5d0b5 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:33.067289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1027/2066] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:33.216567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:33.360385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:33.844630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:34.382142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:34.655258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:34.858515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66796a-3123-42b0-b843-be4a8efb66c8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:34.934331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66796a-3123-42b0-b843-be4a8efb66c8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:34.939899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:34.940701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:34.941014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:34.941276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] PATH_INFO: `/v3/users/23ada718f4b94dc9bccca85315d57ae5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:34.942473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ada718f4b94dc9bccca85315d57ae5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:34.944424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:35.040108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:35.149747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ada718f4b94dc9bccca85315d57ae5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:35.163198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ada718f4b94dc9bccca85315d57ae5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:35.262920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:35.263629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ada718f4b94dc9bccca85315d57ae5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:35.264339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ada718f4b94dc9bccca85315d57ae5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:35.276591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ada718f4b94dc9bccca85315d57ae5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:35.283079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1040/2067] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:34 2022] DELETE /identity/v3/users/23ada718f4b94dc9bccca85315d57ae5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:35.287520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cc91-eb5b-4fe5-93e9-df665baaeb73 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:35.287807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cc91-eb5b-4fe5-93e9-df665baaeb73 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:35.288138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cc91-eb5b-4fe5-93e9-df665baaeb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:35.305900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6480cc91-eb5b-4fe5-93e9-df665baaeb73 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:35.307082 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6480cc91-eb5b-4fe5-93e9-df665baaeb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:35.367723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1028/2068] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:35.377659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:35.379203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:35.436360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9c14f-a825-4652-ab68-35b801df6a62 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:35.440272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:35.441027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:35.441311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:35.441592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:35.451973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:35.453487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:35.463958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1041/2069] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:35.731135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:35.844473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480cc91-eb5b-4fe5-93e9-df665baaeb73 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:35.845906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6480cc91-eb5b-4fe5-93e9-df665baaeb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:35.857873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480cc91-eb5b-4fe5-93e9-df665baaeb73 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:35.863017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:35.863829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:35.864153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:35.864468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] PATH_INFO: `/v3/users/388dfbbff9fb42f0b4200532359d6508` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:35.865682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388dfbbff9fb42f0b4200532359d6508)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:35.867616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:35.970886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:35.972998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:35.996388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d5e2d-ee64-4803-a9fb-9a055299a81b service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:36.002300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:36.003273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:36.003626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:36.004294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] PATH_INFO: `/v3/projects/5c7332e285704f37aea334dc8d1ea1b4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:36.006301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7332e285704f37aea334dc8d1ea1b4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:36.008260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:36.062064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:36.104694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388dfbbff9fb42f0b4200532359d6508'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.111140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7332e285704f37aea334dc8d1ea1b4', 'request_id': 'req-4949f538-4064-432b-8615-722f9d78fe2d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.116887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7332e285704f37aea334dc8d1ea1b4', 'request_id': 'req-4949f538-4064-432b-8615-722f9d78fe2d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.124899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7332e285704f37aea334dc8d1ea1b4', 'request_id': 'req-4949f538-4064-432b-8615-722f9d78fe2d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.193008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388dfbbff9fb42f0b4200532359d6508'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.205237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388dfbbff9fb42f0b4200532359d6508'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.205915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388dfbbff9fb42f0b4200532359d6508'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.213866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9580d8dc-566f-44ef-a270-ea2ac6dbb2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388dfbbff9fb42f0b4200532359d6508'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.220103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1029/2070] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:35 2022] DELETE /identity/v3/users/388dfbbff9fb42f0b4200532359d6508 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:36.224575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60859-465f-459c-82a6-b51b81ad2a98 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:36.227054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60859-465f-459c-82a6-b51b81ad2a98 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:36.227054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b60859-465f-459c-82a6-b51b81ad2a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:36.244807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c7b60859-465f-459c-82a6-b51b81ad2a98 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:36.245859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c7b60859-465f-459c-82a6-b51b81ad2a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:36.278513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] The token cache is being invalidate because project 5c7332e285704f37aea334dc8d1ea1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:36.278926 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.279625 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.281196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1042/2071] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:35 2022] DELETE /identity/v3/projects/5c7332e285704f37aea334dc8d1ea1b4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:36.285026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:36.286421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:36.307171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1030/2072] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:36.317356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b60859-465f-459c-82a6-b51b81ad2a98 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:36.318738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c7b60859-465f-459c-82a6-b51b81ad2a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:36.358768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949f538-4064-432b-8615-722f9d78fe2d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:36.363847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:36.364822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:36.365075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:36.365362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] PATH_INFO: `/v3/users/cab2f6cf5b644f13b075fa6775dd25e4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:36.366590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab2f6cf5b644f13b075fa6775dd25e4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:36.368805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:36.382285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b60859-465f-459c-82a6-b51b81ad2a98 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:36.388088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:36.388952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:36.389710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:36.389832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:36.400993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:36.402428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:36.412396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1031/2073] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:36.413189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:36.414546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:36.427571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25414621-2532-49dd-b720-3c18c56ed651 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:36.432257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:36.437632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:36.437632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:36.437632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] PATH_INFO: `/v3/users/361a68d09c354194abe3a91f8dae656d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:36.437632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361a68d09c354194abe3a91f8dae656d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:36.437632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:36.645050 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:36.658315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab2f6cf5b644f13b075fa6775dd25e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.665154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab2f6cf5b644f13b075fa6775dd25e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.739264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361a68d09c354194abe3a91f8dae656d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.780714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab2f6cf5b644f13b075fa6775dd25e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.781539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab2f6cf5b644f13b075fa6775dd25e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.797980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab2f6cf5b644f13b075fa6775dd25e4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.816424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1043/2074] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:36 2022] DELETE /identity/v3/users/cab2f6cf5b644f13b075fa6775dd25e4 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:36.874943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:36.876743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:36.877253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361a68d09c354194abe3a91f8dae656d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.893079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361a68d09c354194abe3a91f8dae656d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.893706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361a68d09c354194abe3a91f8dae656d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.900791 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-369de5e7-11e1-4d07-afd0-90faf7c10d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361a68d09c354194abe3a91f8dae656d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:36.908196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1032/2075] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:36 2022] DELETE /identity/v3/users/361a68d09c354194abe3a91f8dae656d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:36.912621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b6a48-4da1-48fc-a36f-22da956c7782 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:36.912911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b6a48-4da1-48fc-a36f-22da956c7782 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:36.913191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b6a48-4da1-48fc-a36f-22da956c7782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:36.930397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-159b6a48-4da1-48fc-a36f-22da956c7782 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:36.931607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-159b6a48-4da1-48fc-a36f-22da956c7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:36.942672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abde163-9ba7-4cce-b27f-2e3d3b8dfc47 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:36.994469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:36.995105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1033/2076] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:36.995241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:36.995590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:36.996087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:36.998345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:37.004945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b6a48-4da1-48fc-a36f-22da956c7782 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:37.006309 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-159b6a48-4da1-48fc-a36f-22da956c7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:37.056699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:37.067587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:37.068934 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b6a48-4da1-48fc-a36f-22da956c7782 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:37.069054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:37.073019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:37.073668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:37.073945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:37.074595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:37.084249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1044/2077] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:37.085413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:37.085662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:37.087307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:37.087425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:37.099697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1034/2078] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:37.106081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d11a5-a4a8-45f7-8c2b-cfda854b25fc service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:37.115257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:37.116616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:37.116898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:37.117647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] PATH_INFO: `/v3/projects/f488525d2b2d48e492a1cd2e7b87fe5b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:37.119019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f488525d2b2d48e492a1cd2e7b87fe5b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:37.121051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:37.288934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f488525d2b2d48e492a1cd2e7b87fe5b', 'request_id': 'req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.294416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f488525d2b2d48e492a1cd2e7b87fe5b', 'request_id': 'req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.301490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f488525d2b2d48e492a1cd2e7b87fe5b', 'request_id': 'req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.368464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:37.371121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:37.389309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] The token cache is being invalidate because project f488525d2b2d48e492a1cd2e7b87fe5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:37.390007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2669e-c60d-48d1-aed0-a4535627fe8b service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:37.390365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.403206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.409335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1045/2079] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:37 2022] DELETE /identity/v3/projects/f488525d2b2d48e492a1cd2e7b87fe5b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:37.410293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:37.412378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:37.453064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:37.453871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:37.454201 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:37.454421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] PATH_INFO: `/v3/projects/a8cb8cc5e0f74f4991187e0892e789eb` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:37.455607 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8cb8cc5e0f74f4991187e0892e789eb)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:37.457619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:37.489433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21ed54-3e03-4f42-8cbc-1beedf5c62e7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:37.494174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:37.495052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:37.495332 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:37.495606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] PATH_INFO: `/v3/users/048eff3e29554e2b9a14d4d03f3d0287` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:37.496864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=048eff3e29554e2b9a14d4d03f3d0287)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:37.499489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:37.711403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:37.755079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8cb8cc5e0f74f4991187e0892e789eb', 'request_id': 'req-b746baab-2b5b-4f70-a74a-c978852fb896'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.755708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048eff3e29554e2b9a14d4d03f3d0287'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.761764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8cb8cc5e0f74f4991187e0892e789eb', 'request_id': 'req-b746baab-2b5b-4f70-a74a-c978852fb896'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.764109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048eff3e29554e2b9a14d4d03f3d0287'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.768254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8cb8cc5e0f74f4991187e0892e789eb', 'request_id': 'req-b746baab-2b5b-4f70-a74a-c978852fb896'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.876744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048eff3e29554e2b9a14d4d03f3d0287'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.892802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048eff3e29554e2b9a14d4d03f3d0287'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.905256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048eff3e29554e2b9a14d4d03f3d0287'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.911117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1046/2080] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:37 2022] DELETE /identity/v3/users/048eff3e29554e2b9a14d4d03f3d0287 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:37.911884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:37.913320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:37.937397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] The token cache is being invalidate because project a8cb8cc5e0f74f4991187e0892e789eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:37.938096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.939010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b746baab-2b5b-4f70-a74a-c978852fb896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:37.941317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1035/2081] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:37 2022] DELETE /identity/v3/projects/a8cb8cc5e0f74f4991187e0892e789eb => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:37.947056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f23d1-c84b-4d7b-9afa-c6d095a27463 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:37.956044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f23d1-c84b-4d7b-9afa-c6d095a27463 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:37.956044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f23d1-c84b-4d7b-9afa-c6d095a27463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:37.971045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bf4f23d1-c84b-4d7b-9afa-c6d095a27463 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:37.972535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bf4f23d1-c84b-4d7b-9afa-c6d095a27463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:37.995136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa389dec-98ae-41f2-86c8-3a9e2c2ab82a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:38.001422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:38.002826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:38.003325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:38.003774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] PATH_INFO: `/v3/projects/ebe14d8779a2438eb427e58d739e316f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:38.005298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe14d8779a2438eb427e58d739e316f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:38.008602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:38.049820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1036/2082] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:38.057525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fe28-e40f-40dd-9066-f1754125ff9f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:38.057822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fe28-e40f-40dd-9066-f1754125ff9f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:38.058106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3fe28-e40f-40dd-9066-f1754125ff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:38.077011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fee3fe28-e40f-40dd-9066-f1754125ff9f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:38.082198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fee3fe28-e40f-40dd-9066-f1754125ff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:38.086292 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1037/2083] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:38.090285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3fe28-e40f-40dd-9066-f1754125ff9f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:38.099478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3fe28-e40f-40dd-9066-f1754125ff9f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:38.104509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:38.105157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:38.105438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:38.105714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:38.111239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:38.111239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:38.111239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:38.120814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1038/2084] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:38.125015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:38.135363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639a38b-400a-4e14-b59e-3911fdead4c2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:38.141096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85f88f-cd4f-4af3-86b8-4a92d0036ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:38.141866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85f88f-cd4f-4af3-86b8-4a92d0036ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:38.142434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85f88f-cd4f-4af3-86b8-4a92d0036ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:38.142434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85f88f-cd4f-4af3-86b8-4a92d0036ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:38.143164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85f88f-cd4f-4af3-86b8-4a92d0036ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:38.145280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85f88f-cd4f-4af3-86b8-4a92d0036ce9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:38.188207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe14d8779a2438eb427e58d739e316f', 'request_id': 'req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.193726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe14d8779a2438eb427e58d739e316f', 'request_id': 'req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.200555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe14d8779a2438eb427e58d739e316f', 'request_id': 'req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.268180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1039/2085] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:38 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:38.272952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85f88f-cd4f-4af3-86b8-4a92d0036ce9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:38.301385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] The token cache is being invalidate because project ebe14d8779a2438eb427e58d739e316f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:38.302214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.303009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.304805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1047/2086] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:37 2022] DELETE /identity/v3/projects/ebe14d8779a2438eb427e58d739e316f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:38.308590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:38.310626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:38.352462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85f88f-cd4f-4af3-86b8-4a92d0036ce9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:38.358760 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:38.360039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:38.360502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:38.360785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:38.361920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:38.365513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:38.399063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2dae-1b95-4c3e-a142-5822f3a7b49c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:38.404927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:38.405925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:38.406186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:38.406459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] PATH_INFO: `/v3/users/3282e050b1a74527b2b10c98055a9e27` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:38.407696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3282e050b1a74527b2b10c98055a9e27)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:38.409808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:38.451956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1040/2087] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:38 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:38.453675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:38.455403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:38.468370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae9824-c2e8-45af-a8f9-67291070b11a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:38.473241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:38.476915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:38.476915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:38.476915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] PATH_INFO: `/v3/projects/0e2b501e00ff42ea9c06c29f5ae9c2f5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:38.476915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2b501e00ff42ea9c06c29f5ae9c2f5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:38.477784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:38.688302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3282e050b1a74527b2b10c98055a9e27'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.689648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2b501e00ff42ea9c06c29f5ae9c2f5', 'request_id': 'req-0d288bac-9216-49ae-b399-7fd9bb6192d2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.695548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3282e050b1a74527b2b10c98055a9e27'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.695946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2b501e00ff42ea9c06c29f5ae9c2f5', 'request_id': 'req-0d288bac-9216-49ae-b399-7fd9bb6192d2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.703612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2b501e00ff42ea9c06c29f5ae9c2f5', 'request_id': 'req-0d288bac-9216-49ae-b399-7fd9bb6192d2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.850522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3282e050b1a74527b2b10c98055a9e27'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.851447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3282e050b1a74527b2b10c98055a9e27'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.866907 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3282e050b1a74527b2b10c98055a9e27'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.874314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1048/2088] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:38 2022] DELETE /identity/v3/users/3282e050b1a74527b2b10c98055a9e27 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:38.875108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:38.876670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:38.965208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] The token cache is being invalidate because project 0e2b501e00ff42ea9c06c29f5ae9c2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:38.969555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.969555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d288bac-9216-49ae-b399-7fd9bb6192d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:38.971886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1041/2089] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:38 2022] DELETE /identity/v3/projects/0e2b501e00ff42ea9c06c29f5ae9c2f5 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:38.977970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c022-26fe-43c0-89aa-359faa711bee None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:38.978424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c022-26fe-43c0-89aa-359faa711bee None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:38.978870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c022-26fe-43c0-89aa-359faa711bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.029122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ed4c022-26fe-43c0-89aa-359faa711bee None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:39.030433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ed4c022-26fe-43c0-89aa-359faa711bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:39.038508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e2fdc-df75-4860-a75e-292010bbbf97 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.044985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.045671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.045956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.046235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.047476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.050331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:39.052774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.056475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1042/2090] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:39.064628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a372-a36d-4f98-8bf9-4e052a9c5a0e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.065269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a372-a36d-4f98-8bf9-4e052a9c5a0e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.065570 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a372-a36d-4f98-8bf9-4e052a9c5a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.082340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1049/2091] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:39.083255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.085136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:39.110395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fe51a372-a36d-4f98-8bf9-4e052a9c5a0e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:39.114563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe51a372-a36d-4f98-8bf9-4e052a9c5a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:39.121645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e393-88d6-40c1-a715-9bc746adf4c8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.138314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb35c9-0609-4900-a949-600d92998804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.139063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb35c9-0609-4900-a949-600d92998804 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.139446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb35c9-0609-4900-a949-600d92998804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.139617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb35c9-0609-4900-a949-600d92998804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.140488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb35c9-0609-4900-a949-600d92998804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.144466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb35c9-0609-4900-a949-600d92998804 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.148509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1043/2092] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:39.150842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51a372-a36d-4f98-8bf9-4e052a9c5a0e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.159820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1050/2093] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:39.164767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb35c9-0609-4900-a949-600d92998804 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.174588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51a372-a36d-4f98-8bf9-4e052a9c5a0e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.180462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb35c9-0609-4900-a949-600d92998804 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.182127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.182904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.183260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.183633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.184652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:39.187050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10cbb9-82b4-4f85-8569-e6e7ea67e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.187863 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.188314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cbb9-82b4-4f85-8569-e6e7ea67e11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.188666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cbb9-82b4-4f85-8569-e6e7ea67e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.189036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cbb9-82b4-4f85-8569-e6e7ea67e11b admin admin] PATH_INFO: `/v3/projects/8d0003977961421d99a893e472bae75c/users/d48b41bdc48e4569a92856f7ca425392/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.191047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.209403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1044/2094] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:39.209576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10cbb9-82b4-4f85-8569-e6e7ea67e11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0003977961421d99a893e472bae75c, user_id=d48b41bdc48e4569a92856f7ca425392, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.212047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10cbb9-82b4-4f85-8569-e6e7ea67e11b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.213561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.223789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0806ed-c548-4c70-aee3-22e7a17835db admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.228427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34819f5-71ad-4cb7-b227-e208271e02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.229256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34819f5-71ad-4cb7-b227-e208271e02f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.229595 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34819f5-71ad-4cb7-b227-e208271e02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.229807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34819f5-71ad-4cb7-b227-e208271e02f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.230497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34819f5-71ad-4cb7-b227-e208271e02f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.233548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34819f5-71ad-4cb7-b227-e208271e02f7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.290803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1051/2095] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:39 2022] PUT /identity/v3/projects/8d0003977961421d99a893e472bae75c/users/d48b41bdc48e4569a92856f7ca425392/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:39.301813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a292-19df-4f0c-9333-4f1846b63245 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.302098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a292-19df-4f0c-9333-4f1846b63245 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.302371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a292-19df-4f0c-9333-4f1846b63245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.332804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bfb6a292-19df-4f0c-9333-4f1846b63245 None None] MFA Rules not processed for user `d48b41bdc48e4569a92856f7ca425392`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:39.334015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bfb6a292-19df-4f0c-9333-4f1846b63245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:39.363305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1045/2096] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:39 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:39.367455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34819f5-71ad-4cb7-b227-e208271e02f7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.440699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1052/2097] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:39.455073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6a292-19df-4f0c-9333-4f1846b63245 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.456785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bfb6a292-19df-4f0c-9333-4f1846b63245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:39.488527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34819f5-71ad-4cb7-b227-e208271e02f7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.493470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.494376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.494689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.494966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.495675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.497692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.523694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6a292-19df-4f0c-9333-4f1846b63245 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.571497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ac992-c99d-40ed-a5b2-6bc3305daf24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.572166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac992-c99d-40ed-a5b2-6bc3305daf24 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.572447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac992-c99d-40ed-a5b2-6bc3305daf24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.572722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac992-c99d-40ed-a5b2-6bc3305daf24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.636175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ac992-c99d-40ed-a5b2-6bc3305daf24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.636665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1046/2098] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:39 2022] POST /identity/v3/users => generated 284 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:39.639421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ac992-c99d-40ed-a5b2-6bc3305daf24 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.641259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.643074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:39.648387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1053/2099] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:39.649238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ac992-c99d-40ed-a5b2-6bc3305daf24 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.657052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db106807-4db2-4593-810a-d4e8162cb6a4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.660818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ac992-c99d-40ed-a5b2-6bc3305daf24 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.662769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.663742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.671825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.671825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] PATH_INFO: `/v3/projects/6f56669fcf3346559733d6cfd3f56803` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.672028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae00f-f841-40fa-861a-074456787107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.672028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae00f-f841-40fa-861a-074456787107 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.672200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f56669fcf3346559733d6cfd3f56803)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.672297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae00f-f841-40fa-861a-074456787107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.672297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae00f-f841-40fa-861a-074456787107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.672297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae00f-f841-40fa-861a-074456787107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.672512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.672593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae00f-f841-40fa-861a-074456787107 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.680981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1054/2100] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:39.681771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae00f-f841-40fa-861a-074456787107 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.692302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae00f-f841-40fa-861a-074456787107 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.698760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.700141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.700578 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.700863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] PATH_INFO: `/v3/users/d48b41bdc48e4569a92856f7ca425392` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.702100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48b41bdc48e4569a92856f7ca425392)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.704178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.791151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f56669fcf3346559733d6cfd3f56803', 'request_id': 'req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:39.797079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f56669fcf3346559733d6cfd3f56803', 'request_id': 'req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:39.803564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f56669fcf3346559733d6cfd3f56803', 'request_id': 'req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:39.895996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:39.900719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] The token cache is being invalidate because project 6f56669fcf3346559733d6cfd3f56803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:39.901003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:39.901627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:39.903171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1047/2101] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:39 2022] DELETE /identity/v3/projects/6f56669fcf3346559733d6cfd3f56803 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:39.904549 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:39.905903 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:39.912978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48b41bdc48e4569a92856f7ca425392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:39.920360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48b41bdc48e4569a92856f7ca425392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:39.970550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897b5e0-dbf0-4378-b404-dbd3d5b5e18a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:39.978182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351f703-7404-4a11-adec-e137a66d5c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:39.978182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f703-7404-4a11-adec-e137a66d5c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.978182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f703-7404-4a11-adec-e137a66d5c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.978182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f703-7404-4a11-adec-e137a66d5c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.978720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351f703-7404-4a11-adec-e137a66d5c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:39.979394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351f703-7404-4a11-adec-e137a66d5c78 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:39.990274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1048/2102] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:39.991659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33861c-6136-48f9-b6ce-9ed7dbc4d193 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:39.991970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33861c-6136-48f9-b6ce-9ed7dbc4d193 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:39.992253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33861c-6136-48f9-b6ce-9ed7dbc4d193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:39.998567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48b41bdc48e4569a92856f7ca425392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:39.999192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48b41bdc48e4569a92856f7ca425392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:40.009980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6b33861c-6136-48f9-b6ce-9ed7dbc4d193 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:40.011570 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6b33861c-6136-48f9-b6ce-9ed7dbc4d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:40.012042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48b41bdc48e4569a92856f7ca425392'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:40.018409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1055/2103] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:39 2022] DELETE /identity/v3/users/d48b41bdc48e4569a92856f7ca425392 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:40.019236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.020264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1049/2104] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:40.020966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:40.027290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ddc93-6986-4fd5-9e8c-ce5e1e4e5d69 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.027582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ddc93-6986-4fd5-9e8c-ce5e1e4e5d69 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.027861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ddc93-6986-4fd5-9e8c-ce5e1e4e5d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.045300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-082ddc93-6986-4fd5-9e8c-ce5e1e4e5d69 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:40.046496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-082ddc93-6986-4fd5-9e8c-ce5e1e4e5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:40.085164 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139af5a-de80-4dd8-a9c7-6ee398a30430 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.090204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81e4ba-d499-4615-bf1c-ea6f5e2e36dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.112141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81e4ba-d499-4615-bf1c-ea6f5e2e36dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.112141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81e4ba-d499-4615-bf1c-ea6f5e2e36dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.112141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81e4ba-d499-4615-bf1c-ea6f5e2e36dd admin admin] PATH_INFO: `/v3/projects/a443eae376bb4c15846c5dd0312dc733/users/52b0c457418f45a396e93f964c3d4aa5/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.113455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1050/2105] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:40.113455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8148ae-56e3-45e5-a7d3-e758160640c6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.113455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8148ae-56e3-45e5-a7d3-e758160640c6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.113455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8148ae-56e3-45e5-a7d3-e758160640c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.118961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81e4ba-d499-4615-bf1c-ea6f5e2e36dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a443eae376bb4c15846c5dd0312dc733, user_id=52b0c457418f45a396e93f964c3d4aa5, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.121754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81e4ba-d499-4615-bf1c-ea6f5e2e36dd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.132418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1a8148ae-56e3-45e5-a7d3-e758160640c6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:40.133785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a8148ae-56e3-45e5-a7d3-e758160640c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:40.143416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1051/2106] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:40.144271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8148ae-56e3-45e5-a7d3-e758160640c6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.145590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a8148ae-56e3-45e5-a7d3-e758160640c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:40.212625 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1056/2107] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:40 2022] PUT /identity/v3/projects/a443eae376bb4c15846c5dd0312dc733/users/52b0c457418f45a396e93f964c3d4aa5/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:40.218997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81e4ba-d499-4615-bf1c-ea6f5e2e36dd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.219141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8148ae-56e3-45e5-a7d3-e758160640c6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.276941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891e139-0d09-4caf-a9cb-065a2aef4cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.277680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891e139-0d09-4caf-a9cb-065a2aef4cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.278012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891e139-0d09-4caf-a9cb-065a2aef4cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.278340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891e139-0d09-4caf-a9cb-065a2aef4cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.287857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81e4ba-d499-4615-bf1c-ea6f5e2e36dd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.288070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891e139-0d09-4caf-a9cb-065a2aef4cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.289413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891e139-0d09-4caf-a9cb-065a2aef4cf9 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.292630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.293287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.293572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.293850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.295614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:40.295943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.297540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.299943 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1052/2108] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:40.301735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddce38-09c7-4f4f-ac6a-3783fd2ade20 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.301735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddce38-09c7-4f4f-ac6a-3783fd2ade20 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.301949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddce38-09c7-4f4f-ac6a-3783fd2ade20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.310153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1057/2109] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:40.314654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.333404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0efe6-ffff-4cdb-8e22-dc4a7833aaea admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.335169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f956f-b0fe-4b44-b7c6-2a774dd0eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.335408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-01ddce38-09c7-4f4f-ac6a-3783fd2ade20 None None] MFA Rules not processed for user `52b0c457418f45a396e93f964c3d4aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:40.335728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f956f-b0fe-4b44-b7c6-2a774dd0eca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.336056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f956f-b0fe-4b44-b7c6-2a774dd0eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.336327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f956f-b0fe-4b44-b7c6-2a774dd0eca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.337042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f956f-b0fe-4b44-b7c6-2a774dd0eca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.337336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-01ddce38-09c7-4f4f-ac6a-3783fd2ade20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:40.339178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f956f-b0fe-4b44-b7c6-2a774dd0eca8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.424589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1053/2110] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:40.425562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddce38-09c7-4f4f-ac6a-3783fd2ade20 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.436684 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddce38-09c7-4f4f-ac6a-3783fd2ade20 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.441783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404902c-9215-433b-be61-5a3903036ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.448230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404902c-9215-433b-be61-5a3903036ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.448230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404902c-9215-433b-be61-5a3903036ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.448230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404902c-9215-433b-be61-5a3903036ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.448230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404902c-9215-433b-be61-5a3903036ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.448230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404902c-9215-433b-be61-5a3903036ec8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.478646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1058/2111] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:40 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:40.479676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f956f-b0fe-4b44-b7c6-2a774dd0eca8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.540989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f956f-b0fe-4b44-b7c6-2a774dd0eca8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.545882 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b164-db6f-4d6d-b5db-cf4042d4b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.546520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b164-db6f-4d6d-b5db-cf4042d4b0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.546804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b164-db6f-4d6d-b5db-cf4042d4b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.547078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b164-db6f-4d6d-b5db-cf4042d4b0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.547780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7b164-db6f-4d6d-b5db-cf4042d4b0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.549740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7b164-db6f-4d6d-b5db-cf4042d4b0d0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.576380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1054/2112] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:40 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:40.580185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404902c-9215-433b-be61-5a3903036ec8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.647871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404902c-9215-433b-be61-5a3903036ec8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.652418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1059/2113] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:40 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:40.653559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b164-db6f-4d6d-b5db-cf4042d4b0d0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.656278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:40.657758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e3a04-385c-477a-a402-6202b0464990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.658069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3a04-385c-477a-a402-6202b0464990 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.658352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3a04-385c-477a-a402-6202b0464990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.658630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e3a04-385c-477a-a402-6202b0464990 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.659342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e3a04-385c-477a-a402-6202b0464990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.661363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e3a04-385c-477a-a402-6202b0464990 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.666450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b164-db6f-4d6d-b5db-cf4042d4b0d0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.672462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be40ea-61d8-421a-b77c-9545eb252e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.673274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be40ea-61d8-421a-b77c-9545eb252e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.673478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be40ea-61d8-421a-b77c-9545eb252e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.673826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be40ea-61d8-421a-b77c-9545eb252e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.674562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be40ea-61d8-421a-b77c-9545eb252e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.676310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be40ea-61d8-421a-b77c-9545eb252e65 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.690039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1060/2114] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:40.691341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be40ea-61d8-421a-b77c-9545eb252e65 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.700873 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be40ea-61d8-421a-b77c-9545eb252e65 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.705819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f849c-63fa-4726-8eab-4229281ed005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.706624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f849c-63fa-4726-8eab-4229281ed005 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.706984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f849c-63fa-4726-8eab-4229281ed005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.707603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f849c-63fa-4726-8eab-4229281ed005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.708092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f849c-63fa-4726-8eab-4229281ed005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.709707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f849c-63fa-4726-8eab-4229281ed005 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.720991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1061/2115] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:40.724913 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f849c-63fa-4726-8eab-4229281ed005 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.736866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f849c-63fa-4726-8eab-4229281ed005 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.746133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.747016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.747837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.749718 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] PATH_INFO: `/v3/projects/f0f6b9294bde4d5ba773449f1be4f147/users/4f4686adc0674a129330fb4d28818bf5/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.750678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1055/2116] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:40 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:40.754453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e3a04-385c-477a-a402-6202b0464990 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.764930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e3a04-385c-477a-a402-6202b0464990 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.767340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f6b9294bde4d5ba773449f1be4f147, user_id=4f4686adc0674a129330fb4d28818bf5, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.769816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb168a-4013-4878-955c-dc80e3b0048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.772691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.772918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb168a-4013-4878-955c-dc80e3b0048d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.772918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb168a-4013-4878-955c-dc80e3b0048d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.772918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb168a-4013-4878-955c-dc80e3b0048d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.772918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb168a-4013-4878-955c-dc80e3b0048d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.773663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb168a-4013-4878-955c-dc80e3b0048d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.788289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1056/2117] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:40.789228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb168a-4013-4878-955c-dc80e3b0048d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.803582 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb168a-4013-4878-955c-dc80e3b0048d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.806720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67fc15-54da-4159-9915-9bd43fa98ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:40.807633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fc15-54da-4159-9915-9bd43fa98ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.807940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fc15-54da-4159-9915-9bd43fa98ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.808205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67fc15-54da-4159-9915-9bd43fa98ee6 admin admin] PATH_INFO: `/v3/projects/38707bde1064405aa6266ebb6fb9cc1b/users/375c87fffa684b2eb53403853a133d4e/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.828042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67fc15-54da-4159-9915-9bd43fa98ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38707bde1064405aa6266ebb6fb9cc1b, user_id=375c87fffa684b2eb53403853a133d4e, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:40.836412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67fc15-54da-4159-9915-9bd43fa98ee6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:40.894140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1062/2118] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:40 2022] PUT /identity/v3/projects/f0f6b9294bde4d5ba773449f1be4f147/users/4f4686adc0674a129330fb4d28818bf5/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:40.894969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:40.896571 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:40.935743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1057/2119] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:40 2022] PUT /identity/v3/projects/38707bde1064405aa6266ebb6fb9cc1b/users/375c87fffa684b2eb53403853a133d4e/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:40.935743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0252-3ade-46cb-ab8a-d135a2e75227 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:40.935743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0252-3ade-46cb-ab8a-d135a2e75227 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:40.935743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f0252-3ade-46cb-ab8a-d135a2e75227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:40.959937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cec581-a6c0-4494-9392-299a7451d614 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:40.961229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b35f0252-3ade-46cb-ab8a-d135a2e75227 None None] MFA Rules not processed for user `4f4686adc0674a129330fb4d28818bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:40.962445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b35f0252-3ade-46cb-ab8a-d135a2e75227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.015812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.016795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.017081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.017392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] PATH_INFO: `/v3/projects/8d0003977961421d99a893e472bae75c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.018583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0003977961421d99a893e472bae75c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.020582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.026850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1058/2120] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:41.027629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f0252-3ade-46cb-ab8a-d135a2e75227 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.041735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f0252-3ade-46cb-ab8a-d135a2e75227 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.047407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58b61-097b-4d18-bc7c-5da93b29706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.048099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58b61-097b-4d18-bc7c-5da93b29706c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.048389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58b61-097b-4d18-bc7c-5da93b29706c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.048772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58b61-097b-4d18-bc7c-5da93b29706c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.049468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58b61-097b-4d18-bc7c-5da93b29706c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.051149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58b61-097b-4d18-bc7c-5da93b29706c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.061894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1059/2121] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:41.062680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58b61-097b-4d18-bc7c-5da93b29706c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.072232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58b61-097b-4d18-bc7c-5da93b29706c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.077079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501760cf-547e-4d67-abff-bb249c32c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.077819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501760cf-547e-4d67-abff-bb249c32c5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.078100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501760cf-547e-4d67-abff-bb249c32c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.078376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501760cf-547e-4d67-abff-bb249c32c5d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.079057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501760cf-547e-4d67-abff-bb249c32c5d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.080988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501760cf-547e-4d67-abff-bb249c32c5d0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.164581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0003977961421d99a893e472bae75c', 'request_id': 'req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:41.171015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0003977961421d99a893e472bae75c', 'request_id': 'req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:41.171258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:41.177390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0003977961421d99a893e472bae75c', 'request_id': 'req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:41.205570 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1060/2122] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:41 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:41.206410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501760cf-547e-4d67-abff-bb249c32c5d0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.261744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] The token cache is being invalidate because project 8d0003977961421d99a893e472bae75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:41.262037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:41.263559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:41.267169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1063/2123] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:40 2022] DELETE /identity/v3/projects/8d0003977961421d99a893e472bae75c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:41.267169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.268511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.275779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501760cf-547e-4d67-abff-bb249c32c5d0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.282281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b6b77-59d5-48eb-be5c-6a7fc7bad674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.283174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b77-59d5-48eb-be5c-6a7fc7bad674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.283461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b77-59d5-48eb-be5c-6a7fc7bad674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.284740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b6b77-59d5-48eb-be5c-6a7fc7bad674 admin admin] PATH_INFO: `/v3/projects/38707bde1064405aa6266ebb6fb9cc1b/users/375c87fffa684b2eb53403853a133d4e/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.286013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b6b77-59d5-48eb-be5c-6a7fc7bad674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38707bde1064405aa6266ebb6fb9cc1b, user_id=375c87fffa684b2eb53403853a133d4e, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.288775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b6b77-59d5-48eb-be5c-6a7fc7bad674 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.299835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1061/2124] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:41 2022] PUT /identity/v3/projects/38707bde1064405aa6266ebb6fb9cc1b/users/375c87fffa684b2eb53403853a133d4e/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:41.301339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d4d67-e55c-4ddd-8e2f-1facceb4841d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.301753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d4d67-e55c-4ddd-8e2f-1facceb4841d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.302035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d4d67-e55c-4ddd-8e2f-1facceb4841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.325959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ea6d4d67-e55c-4ddd-8e2f-1facceb4841d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:41.327145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ea6d4d67-e55c-4ddd-8e2f-1facceb4841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.336088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa102-70f6-49f9-9bf1-ac7dc3c31677 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.400745 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1062/2125] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:41.402033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a28c49-b255-4126-b1c9-0a6a3d9e1c1d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.402317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a28c49-b255-4126-b1c9-0a6a3d9e1c1d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.402593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a28c49-b255-4126-b1c9-0a6a3d9e1c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.411178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c532-7317-45ed-a333-9467b6542ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.411962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c532-7317-45ed-a333-9467b6542ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.412318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c532-7317-45ed-a333-9467b6542ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.412659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407c532-7317-45ed-a333-9467b6542ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.413547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407c532-7317-45ed-a333-9467b6542ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.415553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407c532-7317-45ed-a333-9467b6542ea1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.430945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-32a28c49-b255-4126-b1c9-0a6a3d9e1c1d None None] MFA Rules not processed for user `375c87fffa684b2eb53403853a133d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:41.432247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-32a28c49-b255-4126-b1c9-0a6a3d9e1c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.499251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1063/2126] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:41.500631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451552b-0e61-4c29-8845-82e1e36695cd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.500924 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451552b-0e61-4c29-8845-82e1e36695cd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.501205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451552b-0e61-4c29-8845-82e1e36695cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.521062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b451552b-0e61-4c29-8845-82e1e36695cd None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:41.521855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b451552b-0e61-4c29-8845-82e1e36695cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.530975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1064/2127] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:41.532177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1064/2128] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:41 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:41.535457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451552b-0e61-4c29-8845-82e1e36695cd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.536059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c532-7317-45ed-a333-9467b6542ea1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.537084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b451552b-0e61-4c29-8845-82e1e36695cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.551189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407c532-7317-45ed-a333-9467b6542ea1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.553435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:41.560786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.561451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.561734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.562008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.562789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:41.563062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.564715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.580360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1065/2129] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:41.581338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.596463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a1065-ca36-4fd8-b9a6-b929adb8f5a3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.603230 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451552b-0e61-4c29-8845-82e1e36695cd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.604233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef0895-0cac-409c-95e6-96d806d939d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.605117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef0895-0cac-409c-95e6-96d806d939d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.605594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef0895-0cac-409c-95e6-96d806d939d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.606045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef0895-0cac-409c-95e6-96d806d939d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.606933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af162d-1032-4687-b0b8-3f1eef585ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.607439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef0895-0cac-409c-95e6-96d806d939d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.607558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af162d-1032-4687-b0b8-3f1eef585ebb service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.607848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af162d-1032-4687-b0b8-3f1eef585ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.608161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af162d-1032-4687-b0b8-3f1eef585ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.609093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef0895-0cac-409c-95e6-96d806d939d9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.618157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af162d-1032-4687-b0b8-3f1eef585ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.619584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af162d-1032-4687-b0b8-3f1eef585ebb service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.622070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1066/2130] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:41.623947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80e0d-11d5-40eb-9089-2bf1fb7d254e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.624442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80e0d-11d5-40eb-9089-2bf1fb7d254e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.624948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80e0d-11d5-40eb-9089-2bf1fb7d254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.640070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1065/2131] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:41.641116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af162d-1032-4687-b0b8-3f1eef585ebb service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.644863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-dbd80e0d-11d5-40eb-9089-2bf1fb7d254e None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:41.646061 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dbd80e0d-11d5-40eb-9089-2bf1fb7d254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.656411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af162d-1032-4687-b0b8-3f1eef585ebb service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.661568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.662311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.662668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.663189 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.663998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.666243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.717893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1067/2132] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:41.718739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd80e0d-11d5-40eb-9089-2bf1fb7d254e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.730816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd80e0d-11d5-40eb-9089-2bf1fb7d254e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.736742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.738098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.738648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.739010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] PATH_INFO: `/v3/projects/29edcc09af184608bca7a886ac377699/users/6979abe0c69847039a96b4f2d18f14f6/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.762128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=29edcc09af184608bca7a886ac377699, user_id=6979abe0c69847039a96b4f2d18f14f6, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.765896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.772870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1066/2133] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:41 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:41.774004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.775977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.844133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbfa6e-223a-4569-a656-a931eff0f010 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.849438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a28b9-3161-4824-bbd9-cae9f8bb7654 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.850080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a28b9-3161-4824-bbd9-cae9f8bb7654 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.850364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a28b9-3161-4824-bbd9-cae9f8bb7654 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.850646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a28b9-3161-4824-bbd9-cae9f8bb7654 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.868303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1068/2134] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:41 2022] PUT /identity/v3/projects/29edcc09af184608bca7a886ac377699/users/6979abe0c69847039a96b4f2d18f14f6/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:41.869341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.871226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.874085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:41.910273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a28b9-3161-4824-bbd9-cae9f8bb7654 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:41.911855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a28b9-3161-4824-bbd9-cae9f8bb7654 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:41.920101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1067/2135] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:41.920710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a28b9-3161-4824-bbd9-cae9f8bb7654 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:41.936914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a0ab-01e6-4949-9118-8efa1d8ffeed admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:41.943435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:41.944007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:41.944278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:41.944559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:41.946476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:41.990689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a28b9-3161-4824-bbd9-cae9f8bb7654 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.014235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.015878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.024954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1069/2136] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:42.025807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.046412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:42.053854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45bddd-c131-4ecf-9af1-61ba49ec2782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.054380 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45bddd-c131-4ecf-9af1-61ba49ec2782 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.054698 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45bddd-c131-4ecf-9af1-61ba49ec2782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.054975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45bddd-c131-4ecf-9af1-61ba49ec2782 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.055830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45bddd-c131-4ecf-9af1-61ba49ec2782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.057864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45bddd-c131-4ecf-9af1-61ba49ec2782 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.097176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09bd5e-24fb-457a-895e-23d099e3aff8 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.102869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765edba-29ba-4731-b226-442e0995a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.103742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765edba-29ba-4731-b226-442e0995a1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.104326 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765edba-29ba-4731-b226-442e0995a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.104611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765edba-29ba-4731-b226-442e0995a1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.105422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765edba-29ba-4731-b226-442e0995a1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.107724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765edba-29ba-4731-b226-442e0995a1f5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.118205 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1070/2137] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:42.122775 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765edba-29ba-4731-b226-442e0995a1f5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.133222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765edba-29ba-4731-b226-442e0995a1f5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.139248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87b28-3741-4e64-a38b-8f1e10ee3888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.140235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87b28-3741-4e64-a38b-8f1e10ee3888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.140621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87b28-3741-4e64-a38b-8f1e10ee3888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.140970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87b28-3741-4e64-a38b-8f1e10ee3888 admin admin] PATH_INFO: `/v3/projects/29edcc09af184608bca7a886ac377699/users/6979abe0c69847039a96b4f2d18f14f6/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.143018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87b28-3741-4e64-a38b-8f1e10ee3888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29edcc09af184608bca7a886ac377699, user_id=6979abe0c69847039a96b4f2d18f14f6, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.145715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87b28-3741-4e64-a38b-8f1e10ee3888 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.161240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1068/2138] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:41 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:42.165574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45bddd-c131-4ecf-9af1-61ba49ec2782 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.171301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1071/2139] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:42 2022] PUT /identity/v3/projects/29edcc09af184608bca7a886ac377699/users/6979abe0c69847039a96b4f2d18f14f6/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:42.181741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add62d0-2dc2-4c1e-968b-422099b6c424 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.182122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add62d0-2dc2-4c1e-968b-422099b6c424 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.182429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add62d0-2dc2-4c1e-968b-422099b6c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.187290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45bddd-c131-4ecf-9af1-61ba49ec2782 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.211004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3add62d0-2dc2-4c1e-968b-422099b6c424 None None] MFA Rules not processed for user `6979abe0c69847039a96b4f2d18f14f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:42.212458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3add62d0-2dc2-4c1e-968b-422099b6c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:42.255540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8447a-ec22-4976-9f08-000135ce9051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.256290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8447a-ec22-4976-9f08-000135ce9051 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.256763 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8447a-ec22-4976-9f08-000135ce9051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.257105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8447a-ec22-4976-9f08-000135ce9051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.257982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8447a-ec22-4976-9f08-000135ce9051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.259682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8447a-ec22-4976-9f08-000135ce9051 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.270147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1069/2140] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:42.273944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8447a-ec22-4976-9f08-000135ce9051 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.287528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1072/2141] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:42.295241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8447a-ec22-4976-9f08-000135ce9051 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.300391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613eca9-14e0-438f-8b83-f6938a1d6792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.301059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613eca9-14e0-438f-8b83-f6938a1d6792 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.301346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613eca9-14e0-438f-8b83-f6938a1d6792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.301650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613eca9-14e0-438f-8b83-f6938a1d6792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.302551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613eca9-14e0-438f-8b83-f6938a1d6792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.304253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613eca9-14e0-438f-8b83-f6938a1d6792 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.319000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1070/2142] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:42.320166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add62d0-2dc2-4c1e-968b-422099b6c424 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.330455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add62d0-2dc2-4c1e-968b-422099b6c424 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.335014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c1295-deb3-42e0-a5f3-eb331ec27da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.335886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c1295-deb3-42e0-a5f3-eb331ec27da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.336200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c1295-deb3-42e0-a5f3-eb331ec27da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.336478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c1295-deb3-42e0-a5f3-eb331ec27da1 admin admin] PATH_INFO: `/v3/projects/758c91b1102c43e3a70abadd18d5772c/users/982f4bf780bb4e9da504e20bf896ab90/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.347887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613eca9-14e0-438f-8b83-f6938a1d6792 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.357632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c1295-deb3-42e0-a5f3-eb331ec27da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758c91b1102c43e3a70abadd18d5772c, user_id=982f4bf780bb4e9da504e20bf896ab90, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.360598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c1295-deb3-42e0-a5f3-eb331ec27da1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.364594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:42.408772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613eca9-14e0-438f-8b83-f6938a1d6792 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.416869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0b549-83cf-42f3-a8f4-6eb66bc38251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.417514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b549-83cf-42f3-a8f4-6eb66bc38251 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.417825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b549-83cf-42f3-a8f4-6eb66bc38251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.418103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0b549-83cf-42f3-a8f4-6eb66bc38251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.428266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0b549-83cf-42f3-a8f4-6eb66bc38251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.431703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0b549-83cf-42f3-a8f4-6eb66bc38251 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.442052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1071/2143] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:42.493215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1073/2144] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:42 2022] PUT /identity/v3/projects/758c91b1102c43e3a70abadd18d5772c/users/982f4bf780bb4e9da504e20bf896ab90/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:42.504121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389541b2-3d2f-49af-a55c-474c0562051a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.504556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389541b2-3d2f-49af-a55c-474c0562051a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.505004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389541b2-3d2f-49af-a55c-474c0562051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.544733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-389541b2-3d2f-49af-a55c-474c0562051a None None] MFA Rules not processed for user `982f4bf780bb4e9da504e20bf896ab90`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:42.546034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-389541b2-3d2f-49af-a55c-474c0562051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:42.629478 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1072/2145] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:42.725088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:42.818901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c1295-deb3-42e0-a5f3-eb331ec27da1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.822040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389541b2-3d2f-49af-a55c-474c0562051a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.910131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389541b2-3d2f-49af-a55c-474c0562051a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.914266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b088-ce18-4aa9-ab5d-1a3d0981d0fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.915087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b088-ce18-4aa9-ab5d-1a3d0981d0fe service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.915372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b088-ce18-4aa9-ab5d-1a3d0981d0fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.915710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b088-ce18-4aa9-ab5d-1a3d0981d0fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.924820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727b088-ce18-4aa9-ab5d-1a3d0981d0fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.926719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727b088-ce18-4aa9-ab5d-1a3d0981d0fe service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.930449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c1295-deb3-42e0-a5f3-eb331ec27da1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.936187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.937286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.937576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.937859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] PATH_INFO: `/v3/users/4f4686adc0674a129330fb4d28818bf5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.938558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1073/2146] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:42.939407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4686adc0674a129330fb4d28818bf5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.941468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:42.964960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b088-ce18-4aa9-ab5d-1a3d0981d0fe service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:42.975822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b088-ce18-4aa9-ab5d-1a3d0981d0fe service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:42.980510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:42.981367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:42.981654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:42.981926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] PATH_INFO: `/v3/users/982f4bf780bb4e9da504e20bf896ab90` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:42.983107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982f4bf780bb4e9da504e20bf896ab90)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:42.985091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:43.099247 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:43.184355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:43.194851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982f4bf780bb4e9da504e20bf896ab90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.196688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4686adc0674a129330fb4d28818bf5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.204504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4686adc0674a129330fb4d28818bf5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.262145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:43.284267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982f4bf780bb4e9da504e20bf896ab90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.296636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982f4bf780bb4e9da504e20bf896ab90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.297226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982f4bf780bb4e9da504e20bf896ab90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.303802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-978820ec-182f-4c4a-a4a5-43edfb2612b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982f4bf780bb4e9da504e20bf896ab90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.309601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1074/2147] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:42 2022] DELETE /identity/v3/users/982f4bf780bb4e9da504e20bf896ab90 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:43.311327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ecd5e-b10a-4acb-8e64-31e7ebc36f0b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:43.311611 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ecd5e-b10a-4acb-8e64-31e7ebc36f0b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:43.311888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ecd5e-b10a-4acb-8e64-31e7ebc36f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:43.328712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-707ecd5e-b10a-4acb-8e64-31e7ebc36f0b None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:43.329901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-707ecd5e-b10a-4acb-8e64-31e7ebc36f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:43.339374 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4686adc0674a129330fb4d28818bf5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.340036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4686adc0674a129330fb4d28818bf5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.352261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8aa8833b-a509-4053-85e7-92b8aae06326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4686adc0674a129330fb4d28818bf5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.358047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1074/2148] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:42 2022] DELETE /identity/v3/users/4f4686adc0674a129330fb4d28818bf5 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:43.362283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68ede5-b81a-4293-9b74-623637c767a5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:43.362574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68ede5-b81a-4293-9b74-623637c767a5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:43.362857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68ede5-b81a-4293-9b74-623637c767a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:43.379364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9d68ede5-b81a-4293-9b74-623637c767a5 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:43.380597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9d68ede5-b81a-4293-9b74-623637c767a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:43.385705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1075/2149] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jun 15 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:43.386977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9150c2-094d-4dd3-b666-ab0c1eaf2675 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:43.387271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9150c2-094d-4dd3-b666-ab0c1eaf2675 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:43.387584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9150c2-094d-4dd3-b666-ab0c1eaf2675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:43.406936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2f9150c2-094d-4dd3-b666-ab0c1eaf2675 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:43.408165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2f9150c2-094d-4dd3-b666-ab0c1eaf2675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:43.442265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1075/2150] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:43.443134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68ede5-b81a-4293-9b74-623637c767a5 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:43.444411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9d68ede5-b81a-4293-9b74-623637c767a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:43.456692 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:43.467740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1076/2151] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:43.467740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9150c2-094d-4dd3-b666-ab0c1eaf2675 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:43.472360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2f9150c2-094d-4dd3-b666-ab0c1eaf2675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:43.484056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:43.518536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68ede5-b81a-4293-9b74-623637c767a5 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:43.525320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:43.526055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:43.526435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:43.526756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:43.531383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9150c2-094d-4dd3-b666-ab0c1eaf2675 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:43.537704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:43.538354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:43.538638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:43.538914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:43.549006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:43.550393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:43.560082 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1077/2152] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:43.561382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:43.562701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:43.573552 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65de1d-3c9e-478f-8e25-6ea5aa02ffcf service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:43.577690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca4a21-3981-42d4-a9c4-4f9a1d38da4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:43.578089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca4a21-3981-42d4-a9c4-4f9a1d38da4f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:43.578376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca4a21-3981-42d4-a9c4-4f9a1d38da4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:43.578652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca4a21-3981-42d4-a9c4-4f9a1d38da4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:43.586287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:43.587927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:43.588177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca4a21-3981-42d4-a9c4-4f9a1d38da4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:43.589634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca4a21-3981-42d4-a9c4-4f9a1d38da4f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:43.597514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1076/2153] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:41:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:43.598369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:43.599688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:43.601604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1078/2154] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:43.626093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:43.626342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a638757-c081-4fc9-9ca7-0041a6b7f00b service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:43.634472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:43.635657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:43.636352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:43.636352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] PATH_INFO: `/v3/users/8f36b60e61ad4d8080450232160020f4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:43.638782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f36b60e61ad4d8080450232160020f4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:43.640944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:43.673383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:43.852711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f36b60e61ad4d8080450232160020f4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.862211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f36b60e61ad4d8080450232160020f4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.934790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f36b60e61ad4d8080450232160020f4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.937194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f36b60e61ad4d8080450232160020f4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.957357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f36b60e61ad4d8080450232160020f4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:43.967956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1077/2155] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:43 2022] DELETE /identity/v3/users/8f36b60e61ad4d8080450232160020f4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:43.975873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295bb9c-72eb-48e2-8271-95142166e9bf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:43.976400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295bb9c-72eb-48e2-8271-95142166e9bf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:43.976678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295bb9c-72eb-48e2-8271-95142166e9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:43.995578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d295bb9c-72eb-48e2-8271-95142166e9bf None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:43.996844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d295bb9c-72eb-48e2-8271-95142166e9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.024042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:44.067446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1079/2156] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:44.068288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:44.069056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.079079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295bb9c-72eb-48e2-8271-95142166e9bf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:44.082886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d295bb9c-72eb-48e2-8271-95142166e9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.087206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b59940-39f1-4234-b0c6-8fd0b065eff7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:44.102326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295bb9c-72eb-48e2-8271-95142166e9bf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:44.105211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:44.105457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:44.108895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.109183 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.109454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] PATH_INFO: `/v3/projects/758c91b1102c43e3a70abadd18d5772c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.112982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758c91b1102c43e3a70abadd18d5772c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:44.115125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:44.116142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.120642 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.121213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] PATH_INFO: `/v3/projects/f0f6b9294bde4d5ba773449f1be4f147` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.131812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f6b9294bde4d5ba773449f1be4f147)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:44.131812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:44.255949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758c91b1102c43e3a70abadd18d5772c', 'request_id': 'req-0953d531-fa84-4f4c-9254-8ed74072ec42'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.261514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758c91b1102c43e3a70abadd18d5772c', 'request_id': 'req-0953d531-fa84-4f4c-9254-8ed74072ec42'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.267867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758c91b1102c43e3a70abadd18d5772c', 'request_id': 'req-0953d531-fa84-4f4c-9254-8ed74072ec42'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.284699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:44.303668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f6b9294bde4d5ba773449f1be4f147', 'request_id': 'req-ca50cc69-a61d-442f-b6fe-5266a701b510'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.309975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f6b9294bde4d5ba773449f1be4f147', 'request_id': 'req-ca50cc69-a61d-442f-b6fe-5266a701b510'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.316103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f6b9294bde4d5ba773449f1be4f147', 'request_id': 'req-ca50cc69-a61d-442f-b6fe-5266a701b510'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.421245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] The token cache is being invalidate because project 758c91b1102c43e3a70abadd18d5772c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:44.421541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.422176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.423861 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1078/2157] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:44 2022] DELETE /identity/v3/projects/758c91b1102c43e3a70abadd18d5772c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:44.428191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:44.429473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.484270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953d531-fa84-4f4c-9254-8ed74072ec42 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:44.491235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:44.497055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] The token cache is being invalidate because project f0f6b9294bde4d5ba773449f1be4f147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:44.497423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.498173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ca50cc69-a61d-442f-b6fe-5266a701b510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.499802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1080/2158] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:44 2022] DELETE /identity/v3/projects/f0f6b9294bde4d5ba773449f1be4f147 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:44.501179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0e74-5fc9-48cf-9212-c927018eff90 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.501660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0e74-5fc9-48cf-9212-c927018eff90 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.502010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0e74-5fc9-48cf-9212-c927018eff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.520529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6f6d0e74-5fc9-48cf-9212-c927018eff90 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:44.521798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6f6d0e74-5fc9-48cf-9212-c927018eff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.538380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:44.539026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.539304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.539727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.541428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.580265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1081/2159] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:44.582104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221568c-e002-4f60-9b43-97b185347f8a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.582789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221568c-e002-4f60-9b43-97b185347f8a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.583225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221568c-e002-4f60-9b43-97b185347f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.603294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2221568c-e002-4f60-9b43-97b185347f8a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:44.604500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2221568c-e002-4f60-9b43-97b185347f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.606250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:44.607723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:44.612916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1082/2160] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:44.613367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221568c-e002-4f60-9b43-97b185347f8a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:44.614587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2221568c-e002-4f60-9b43-97b185347f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.617376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1079/2161] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:44.618178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:44.619940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.632833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221568c-e002-4f60-9b43-97b185347f8a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:44.638016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:44.639434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.639746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.640006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] PATH_INFO: `/v3/users/6979abe0c69847039a96b4f2d18f14f6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.641258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6979abe0c69847039a96b4f2d18f14f6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:44.643277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:44.697121 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eebca-6ba4-4745-963c-ed4b61309de1 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:44.702879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd4bfe-161d-4699-85d1-5e2b0856f0ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:44.703528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4bfe-161d-4699-85d1-5e2b0856f0ce service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.703811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4bfe-161d-4699-85d1-5e2b0856f0ce service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.704129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4bfe-161d-4699-85d1-5e2b0856f0ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.712521 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd4bfe-161d-4699-85d1-5e2b0856f0ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:44.714110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd4bfe-161d-4699-85d1-5e2b0856f0ce service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:44.722389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1080/2162] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:41:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:44.723634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c417726-6b68-4a20-928a-a13b34fec477 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.724031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c417726-6b68-4a20-928a-a13b34fec477 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.729511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c417726-6b68-4a20-928a-a13b34fec477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.743725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1c417726-6b68-4a20-928a-a13b34fec477 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:44.745009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c417726-6b68-4a20-928a-a13b34fec477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:44.748769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:44.755382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1081/2163] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:44.759474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c417726-6b68-4a20-928a-a13b34fec477 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:44.769176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c417726-6b68-4a20-928a-a13b34fec477 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:44.773824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:44.777842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.778603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.779125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.779791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:44.780159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:44.782095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:44.800617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1082/2164] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:44.801830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:44.813207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdb444-c323-4893-bb24-516264f0c820 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:44.821649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8830c-c66d-4319-93a2-092e00249f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:44.821649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8830c-c66d-4319-93a2-092e00249f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:44.821649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8830c-c66d-4319-93a2-092e00249f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:44.821649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8830c-c66d-4319-93a2-092e00249f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:44.822204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8830c-c66d-4319-93a2-092e00249f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:44.824214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8830c-c66d-4319-93a2-092e00249f80 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:44.876051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6979abe0c69847039a96b4f2d18f14f6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.929761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1083/2165] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:44 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:44.931305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8830c-c66d-4319-93a2-092e00249f80 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:44.945777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6979abe0c69847039a96b4f2d18f14f6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.987695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6979abe0c69847039a96b4f2d18f14f6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.988629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6979abe0c69847039a96b4f2d18f14f6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:44.996527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6979abe0c69847039a96b4f2d18f14f6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.003567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1083/2166] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:44 2022] DELETE /identity/v3/users/6979abe0c69847039a96b4f2d18f14f6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:45.009700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8830c-c66d-4319-93a2-092e00249f80 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:45.026942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:45.063637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:45.065933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:45.066407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:45.093798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:45.093798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.093798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.093798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.094428 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:45.103514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:45.192561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54c3fc-415d-4275-8753-a0523a41a36e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:45.197868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:45.199027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.199365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.199702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] PATH_INFO: `/v3/projects/6acd0ca31ad647f68ecb0d439a2ca8a9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.201365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6acd0ca31ad647f68ecb0d439a2ca8a9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:45.203347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:45.211964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1084/2167] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:44 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:45.215626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:45.217935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:45.233886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7f93-d037-4deb-95a3-07aef0d124ef admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:45.239239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a77ba-8593-4185-ac35-16dfae6b0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:45.239922 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a77ba-8593-4185-ac35-16dfae6b0f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.240209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a77ba-8593-4185-ac35-16dfae6b0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.240560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a77ba-8593-4185-ac35-16dfae6b0f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.241270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a77ba-8593-4185-ac35-16dfae6b0f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:45.242898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a77ba-8593-4185-ac35-16dfae6b0f73 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:45.254008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1085/2168] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:45.257814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a77ba-8593-4185-ac35-16dfae6b0f73 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:45.269276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a77ba-8593-4185-ac35-16dfae6b0f73 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:45.274600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55711-8714-4e90-bf00-7d9549f00e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:45.275410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55711-8714-4e90-bf00-7d9549f00e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.275692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55711-8714-4e90-bf00-7d9549f00e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.276028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55711-8714-4e90-bf00-7d9549f00e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.277098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55711-8714-4e90-bf00-7d9549f00e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:45.278394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55711-8714-4e90-bf00-7d9549f00e31 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:45.292805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1086/2169] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:45.297436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55711-8714-4e90-bf00-7d9549f00e31 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:45.308166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55711-8714-4e90-bf00-7d9549f00e31 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:45.314091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48cf4c-9466-4fc2-9945-d14d60e924c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:45.314858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cf4c-9466-4fc2-9945-d14d60e924c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.315135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cf4c-9466-4fc2-9945-d14d60e924c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.315404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48cf4c-9466-4fc2-9945-d14d60e924c1 admin admin] PATH_INFO: `/v3/projects/ac1a22a7b7a14121bebe3354d4605922/users/ef7a3117cff54ec6b07027530e9c2d5a/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.332546 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48cf4c-9466-4fc2-9945-d14d60e924c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1a22a7b7a14121bebe3354d4605922, user_id=ef7a3117cff54ec6b07027530e9c2d5a, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:45.335795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48cf4c-9466-4fc2-9945-d14d60e924c1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:45.407450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1087/2170] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:45 2022] PUT /identity/v3/projects/ac1a22a7b7a14121bebe3354d4605922/users/ef7a3117cff54ec6b07027530e9c2d5a/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:45.414852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6acd0ca31ad647f68ecb0d439a2ca8a9', 'request_id': 'req-1f799c9c-ce8e-4245-80f4-088c2a1a422a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.420754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704e3f-0602-4cbe-a321-2083b39b4897 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.423680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704e3f-0602-4cbe-a321-2083b39b4897 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.424010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704e3f-0602-4cbe-a321-2083b39b4897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.427845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6acd0ca31ad647f68ecb0d439a2ca8a9', 'request_id': 'req-1f799c9c-ce8e-4245-80f4-088c2a1a422a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.437462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6acd0ca31ad647f68ecb0d439a2ca8a9', 'request_id': 'req-1f799c9c-ce8e-4245-80f4-088c2a1a422a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.456308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a0704e3f-0602-4cbe-a321-2083b39b4897 None None] MFA Rules not processed for user `ef7a3117cff54ec6b07027530e9c2d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:45.457508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a0704e3f-0602-4cbe-a321-2083b39b4897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:45.511957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:45.521553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1088/2171] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:45.522883 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bffcbe-1845-466c-af8a-abb9886eff8a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.523171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bffcbe-1845-466c-af8a-abb9886eff8a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.523443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bffcbe-1845-466c-af8a-abb9886eff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.544418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-13bffcbe-1845-466c-af8a-abb9886eff8a None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:45.546250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-13bffcbe-1845-466c-af8a-abb9886eff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:45.561462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] The token cache is being invalidate because project 6acd0ca31ad647f68ecb0d439a2ca8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:45.562186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.562383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.564010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1084/2172] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:45 2022] DELETE /identity/v3/projects/6acd0ca31ad647f68ecb0d439a2ca8a9 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:45.564804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:45.566062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:45.601051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1089/2173] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jun 15 00:41:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:45.601821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bffcbe-1845-466c-af8a-abb9886eff8a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:45.606506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-13bffcbe-1845-466c-af8a-abb9886eff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:45.636366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799c9c-ce8e-4245-80f4-088c2a1a422a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:45.640541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:45.641326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.641550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.641827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.643786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:45.655662 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:45.657125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:45.666063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1085/2174] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:45.668682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:45.669534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bffcbe-1845-466c-af8a-abb9886eff8a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:45.671133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:45.675089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:45.676203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.676487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.676761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] PATH_INFO: `/v3/users/dc3b9f10f80241e68e1a878d804c751f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.678497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3b9f10f80241e68e1a878d804c751f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:45.680799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:45.685534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d29e6-16c4-4449-ae3d-97697cf8f98e service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:45.691608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:45.692571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:45.693011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:45.693489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] PATH_INFO: `/v3/projects/29edcc09af184608bca7a886ac377699` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:45.694952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29edcc09af184608bca7a886ac377699)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:45.697151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:45.924130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3b9f10f80241e68e1a878d804c751f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.924931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29edcc09af184608bca7a886ac377699', 'request_id': 'req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.930420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29edcc09af184608bca7a886ac377699', 'request_id': 'req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.930841 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3b9f10f80241e68e1a878d804c751f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:45.936660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29edcc09af184608bca7a886ac377699', 'request_id': 'req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:46.032434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:46.033182 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3b9f10f80241e68e1a878d804c751f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:46.033858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3b9f10f80241e68e1a878d804c751f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:46.046753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3b9f10f80241e68e1a878d804c751f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:46.052720 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1090/2175] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:45 2022] DELETE /identity/v3/users/dc3b9f10f80241e68e1a878d804c751f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:46.053507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:46.054843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:46.129784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189263c3-e160-4fdb-aa91-df86240e1a92 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:46.149752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] The token cache is being invalidate because project 29edcc09af184608bca7a886ac377699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:46.149752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:46.149752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9b7c1501-924a-4b3f-a6ce-1eb76004bcb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:46.149752 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1086/2176] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:45 2022] DELETE /identity/v3/projects/29edcc09af184608bca7a886ac377699 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:46.153366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d3f2-59da-4442-b0c8-25d0c051d4af None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.153741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d3f2-59da-4442-b0c8-25d0c051d4af None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.154896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5d3f2-59da-4442-b0c8-25d0c051d4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.155830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e3bc5-bc11-405d-afc2-c3a943410392 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:46.157408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e3bc5-bc11-405d-afc2-c3a943410392 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.157698 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e3bc5-bc11-405d-afc2-c3a943410392 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.158030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e3bc5-bc11-405d-afc2-c3a943410392 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.160068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d32e3bc5-bc11-405d-afc2-c3a943410392 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:46.183693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-40d5d3f2-59da-4442-b0c8-25d0c051d4af None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:46.184862 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-40d5d3f2-59da-4442-b0c8-25d0c051d4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:46.218648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e3bc5-bc11-405d-afc2-c3a943410392 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:46.220432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e3bc5-bc11-405d-afc2-c3a943410392 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:46.228579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1091/2177] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:41:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:46.248413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1087/2178] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:46.252316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24030d-2a55-41c5-9bd1-b0c1cf6ef158 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.252606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24030d-2a55-41c5-9bd1-b0c1cf6ef158 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.252880 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24030d-2a55-41c5-9bd1-b0c1cf6ef158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.273035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8e24030d-2a55-41c5-9bd1-b0c1cf6ef158 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:46.274556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8e24030d-2a55-41c5-9bd1-b0c1cf6ef158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:46.289045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1092/2179] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:46.290113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d3f2-59da-4442-b0c8-25d0c051d4af None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:46.300712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5d3f2-59da-4442-b0c8-25d0c051d4af None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:46.305883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:46.306593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.314283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.314283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.314283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:46.314283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:46.314283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:46.337138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1088/2180] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:46.338602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24030d-2a55-41c5-9bd1-b0c1cf6ef158 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:46.350722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24030d-2a55-41c5-9bd1-b0c1cf6ef158 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:46.356402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dafa1a-bb2e-4038-895e-416cd6c8bc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:46.357225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dafa1a-bb2e-4038-895e-416cd6c8bc7b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.357577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dafa1a-bb2e-4038-895e-416cd6c8bc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.357925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dafa1a-bb2e-4038-895e-416cd6c8bc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.358696 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dafa1a-bb2e-4038-895e-416cd6c8bc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:46.360699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dafa1a-bb2e-4038-895e-416cd6c8bc7b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:46.493318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1093/2181] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:46 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:46.498311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:46.510902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96761ef1-edef-400e-aac1-e1da5f47cf1b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:46.542007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:46.600744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe391c-49a7-40ee-8caf-051cee109e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:46.601439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe391c-49a7-40ee-8caf-051cee109e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.601929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe391c-49a7-40ee-8caf-051cee109e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.602226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe391c-49a7-40ee-8caf-051cee109e6e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.602929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe391c-49a7-40ee-8caf-051cee109e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:46.605275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe391c-49a7-40ee-8caf-051cee109e6e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:46.741921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1089/2182] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:46 2022] POST /identity/v3/users => generated 305 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:46.743765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dafa1a-bb2e-4038-895e-416cd6c8bc7b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:46.767598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dafa1a-bb2e-4038-895e-416cd6c8bc7b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:46.767598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:46.769112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.769112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.769112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.769797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:46.771744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:46.786864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1094/2183] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:46.792125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe391c-49a7-40ee-8caf-051cee109e6e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:46.799536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:46.803292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:46.804673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe391c-49a7-40ee-8caf-051cee109e6e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:46.827808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6970c8-1d68-41e4-bae7-fc841dee8e04 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:46.841489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96392d-9dcf-4e18-a4d7-5109f6ef0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:46.841489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96392d-9dcf-4e18-a4d7-5109f6ef0df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.841489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96392d-9dcf-4e18-a4d7-5109f6ef0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.841489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96392d-9dcf-4e18-a4d7-5109f6ef0df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.842204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96392d-9dcf-4e18-a4d7-5109f6ef0df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:46.842204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96392d-9dcf-4e18-a4d7-5109f6ef0df8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:46.844857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:46.846292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.846580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.847952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] PATH_INFO: `/v3/projects/a096d63a070f45d6b87a49a285abdf3f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.848536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a096d63a070f45d6b87a49a285abdf3f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:46.851258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1090/2184] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:46.851640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:46.855602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96392d-9dcf-4e18-a4d7-5109f6ef0df8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:46.870646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96392d-9dcf-4e18-a4d7-5109f6ef0df8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:46.877905 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d86739-1e28-46f4-8fb1-1adaa0f32a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:46.878854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d86739-1e28-46f4-8fb1-1adaa0f32a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:46.879146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d86739-1e28-46f4-8fb1-1adaa0f32a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:46.879561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d86739-1e28-46f4-8fb1-1adaa0f32a2f admin admin] PATH_INFO: `/v3/projects/f81b19c9a7c644f18f53c8b5f52900d2/users/4fd39e09278b40af8775b6e538769c5a/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:46.899755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d86739-1e28-46f4-8fb1-1adaa0f32a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81b19c9a7c644f18f53c8b5f52900d2, user_id=4fd39e09278b40af8775b6e538769c5a, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:46.902735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d86739-1e28-46f4-8fb1-1adaa0f32a2f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:46.997265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1091/2185] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:46 2022] PUT /identity/v3/projects/f81b19c9a7c644f18f53c8b5f52900d2/users/4fd39e09278b40af8775b6e538769c5a/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:47.008744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6fc04-7d03-4125-9e82-4458633f717e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.009166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6fc04-7d03-4125-9e82-4458633f717e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.009506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6fc04-7d03-4125-9e82-4458633f717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.010760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a096d63a070f45d6b87a49a285abdf3f', 'request_id': 'req-36445be0-26f7-458e-b596-e5fad327afa1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:47.017911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a096d63a070f45d6b87a49a285abdf3f', 'request_id': 'req-36445be0-26f7-458e-b596-e5fad327afa1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:47.028207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a096d63a070f45d6b87a49a285abdf3f', 'request_id': 'req-36445be0-26f7-458e-b596-e5fad327afa1'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:47.037280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cdb6fc04-7d03-4125-9e82-4458633f717e None None] MFA Rules not processed for user `4fd39e09278b40af8775b6e538769c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:47.038509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cdb6fc04-7d03-4125-9e82-4458633f717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:47.102099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1092/2186] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:47.106500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6fc04-7d03-4125-9e82-4458633f717e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.114191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] The token cache is being invalidate because project a096d63a070f45d6b87a49a285abdf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:47.114700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:47.115551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-36445be0-26f7-458e-b596-e5fad327afa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:47.119017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1095/2187] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:46 2022] DELETE /identity/v3/projects/a096d63a070f45d6b87a49a285abdf3f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:47.125877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2068cd-dc4c-45e0-a131-f7f0fa9d5dcc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.126444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2068cd-dc4c-45e0-a131-f7f0fa9d5dcc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.127042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2068cd-dc4c-45e0-a131-f7f0fa9d5dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.147644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3c2068cd-dc4c-45e0-a131-f7f0fa9d5dcc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:47.150185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3c2068cd-dc4c-45e0-a131-f7f0fa9d5dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:47.179954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6fc04-7d03-4125-9e82-4458633f717e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.184664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.185345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.185816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.186207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.187022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.188971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.212526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1096/2188] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:47.222488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e52a0-05fc-4229-bcea-e7a8cb571793 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.222703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e52a0-05fc-4229-bcea-e7a8cb571793 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.222980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e52a0-05fc-4229-bcea-e7a8cb571793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.242123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-421e52a0-05fc-4229-bcea-e7a8cb571793 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:47.243317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-421e52a0-05fc-4229-bcea-e7a8cb571793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:47.251248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1097/2189] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:47.255415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e52a0-05fc-4229-bcea-e7a8cb571793 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.265169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e52a0-05fc-4229-bcea-e7a8cb571793 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.270795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.271443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.271724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.272028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.272826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:47.273073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.274715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.287777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1098/2190] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:47.292124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.302300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015796a7-0f2b-415a-b240-800cbf25ac9f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.304208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1093/2191] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:47 2022] POST /identity/v3/projects => generated 409 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:47.307868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.309510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:47.367833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b5685-37ae-432e-904b-265a261fc25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.368807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b5685-37ae-432e-904b-265a261fc25e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.369094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b5685-37ae-432e-904b-265a261fc25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.369373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b5685-37ae-432e-904b-265a261fc25e admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.370066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b5685-37ae-432e-904b-265a261fc25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.371996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b5685-37ae-432e-904b-265a261fc25e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.377974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5e345-d5ea-45d1-9582-99039433e7dc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.385210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f25e72-815d-41a8-a230-104abd14e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.385210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f25e72-815d-41a8-a230-104abd14e805 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.385210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f25e72-815d-41a8-a230-104abd14e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.385210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f25e72-815d-41a8-a230-104abd14e805 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.385786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f25e72-815d-41a8-a230-104abd14e805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.387089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f25e72-815d-41a8-a230-104abd14e805 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.405226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:47.477101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1099/2192] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:47 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:47.479931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b5685-37ae-432e-904b-265a261fc25e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.511086 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1094/2193] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:47 2022] POST /identity/v3/users => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:47.515968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f25e72-815d-41a8-a230-104abd14e805 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.527772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f25e72-815d-41a8-a230-104abd14e805 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.577200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b5685-37ae-432e-904b-265a261fc25e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.582808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d47a-dfb5-4b07-9a86-04e706457979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.583647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d47a-dfb5-4b07-9a86-04e706457979 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.584187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d47a-dfb5-4b07-9a86-04e706457979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.592434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d47a-dfb5-4b07-9a86-04e706457979 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.592434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19d47a-dfb5-4b07-9a86-04e706457979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.592434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19d47a-dfb5-4b07-9a86-04e706457979 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.601086 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.601769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.602059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.602327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.605074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.608920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.622420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1095/2194] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:47.623578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.631568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:47.647810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2802b19-8e88-429b-9fa7-8645ceab58a7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.653613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.655942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.656264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.656721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] PATH_INFO: `/v3/users/52b0c457418f45a396e93f964c3d4aa5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.657955 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b0c457418f45a396e93f964c3d4aa5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.660338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.712852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1100/2195] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:47 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:47.713999 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d47a-dfb5-4b07-9a86-04e706457979 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.725358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d47a-dfb5-4b07-9a86-04e706457979 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.739251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd162e-6081-4af8-b333-c51d3cdd9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.740194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd162e-6081-4af8-b333-c51d3cdd9fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.740476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd162e-6081-4af8-b333-c51d3cdd9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.740753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd162e-6081-4af8-b333-c51d3cdd9fd3 admin admin] PATH_INFO: `/v3/projects/277750a6fb3a4e089c0ce0ded2416d54/users/aa1c5656781f4358b1999bfd7d5a2c95/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.758669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd162e-6081-4af8-b333-c51d3cdd9fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277750a6fb3a4e089c0ce0ded2416d54, user_id=aa1c5656781f4358b1999bfd7d5a2c95, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.761772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd162e-6081-4af8-b333-c51d3cdd9fd3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.842628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1101/2196] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:47 2022] PUT /identity/v3/projects/277750a6fb3a4e089c0ce0ded2416d54/users/aa1c5656781f4358b1999bfd7d5a2c95/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:47.843989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd162e-6081-4af8-b333-c51d3cdd9fd3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.891807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b0c457418f45a396e93f964c3d4aa5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:47.909529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd162e-6081-4af8-b333-c51d3cdd9fd3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.914169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0304a9-12ae-4a2e-ae3d-f2fa687ae15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.914818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0304a9-12ae-4a2e-ae3d-f2fa687ae15b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.915098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0304a9-12ae-4a2e-ae3d-f2fa687ae15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.915418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0304a9-12ae-4a2e-ae3d-f2fa687ae15b admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.916171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0304a9-12ae-4a2e-ae3d-f2fa687ae15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.917748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0304a9-12ae-4a2e-ae3d-f2fa687ae15b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.927164 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1102/2197] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:47.928002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0304a9-12ae-4a2e-ae3d-f2fa687ae15b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.939185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0304a9-12ae-4a2e-ae3d-f2fa687ae15b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.944461 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5ebc4-db5d-4981-9151-13461a8ab357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.945074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5ebc4-db5d-4981-9151-13461a8ab357 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.945470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5ebc4-db5d-4981-9151-13461a8ab357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.945749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5ebc4-db5d-4981-9151-13461a8ab357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.946451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5ebc4-db5d-4981-9151-13461a8ab357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.948009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5ebc4-db5d-4981-9151-13461a8ab357 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.958264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1103/2198] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:47.959057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5ebc4-db5d-4981-9151-13461a8ab357 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.968565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5ebc4-db5d-4981-9151-13461a8ab357 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:47.973123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ea5c5-1c6a-4069-98cf-37059770d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:47.973752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ea5c5-1c6a-4069-98cf-37059770d110 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:47.974030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ea5c5-1c6a-4069-98cf-37059770d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:47.974299 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ea5c5-1c6a-4069-98cf-37059770d110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:47.975040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ea5c5-1c6a-4069-98cf-37059770d110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:47.976675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ea5c5-1c6a-4069-98cf-37059770d110 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:47.986545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b0c457418f45a396e93f964c3d4aa5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:47.990648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1104/2199] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:47.990648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ea5c5-1c6a-4069-98cf-37059770d110 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:47.998975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ea5c5-1c6a-4069-98cf-37059770d110 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:48.004010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d681219-1cfd-40ae-bb4b-16dcf5192260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:48.004921 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d681219-1cfd-40ae-bb4b-16dcf5192260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.005200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d681219-1cfd-40ae-bb4b-16dcf5192260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.005481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b0c457418f45a396e93f964c3d4aa5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:48.005591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d681219-1cfd-40ae-bb4b-16dcf5192260 admin admin] PATH_INFO: `/v3/projects/277750a6fb3a4e089c0ce0ded2416d54/users/aa1c5656781f4358b1999bfd7d5a2c95/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.006275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b0c457418f45a396e93f964c3d4aa5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:48.007649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d681219-1cfd-40ae-bb4b-16dcf5192260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277750a6fb3a4e089c0ce0ded2416d54, user_id=aa1c5656781f4358b1999bfd7d5a2c95, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:48.010727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d681219-1cfd-40ae-bb4b-16dcf5192260 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:48.014318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b0c457418f45a396e93f964c3d4aa5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:48.021458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1096/2200] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:47 2022] DELETE /identity/v3/users/52b0c457418f45a396e93f964c3d4aa5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:48.021722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1105/2201] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:47 2022] PUT /identity/v3/projects/277750a6fb3a4e089c0ce0ded2416d54/users/aa1c5656781f4358b1999bfd7d5a2c95/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:48.025152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:48.026624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.031829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92745f68-2f47-4481-a70f-34eadb342511 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.032141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92745f68-2f47-4481-a70f-34eadb342511 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.032416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92745f68-2f47-4481-a70f-34eadb342511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.050117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-92745f68-2f47-4481-a70f-34eadb342511 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:48.054194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-92745f68-2f47-4481-a70f-34eadb342511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.089893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd541b-8805-47ed-a489-3d17ac7f973a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:48.094882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:48.095785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.096100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.096378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] PATH_INFO: `/v3/projects/4f59e93c39574a5ead24df091d959eae/users/52a0bc7bca214a6cbab78e5a1d122be2/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.110616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1106/2202] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:48.117897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f59e93c39574a5ead24df091d959eae, user_id=52a0bc7bca214a6cbab78e5a1d122be2, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:48.118436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:48.121154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e3ec8-abc1-40f4-b7d2-ae24ce2baaeb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.125174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e3ec8-abc1-40f4-b7d2-ae24ce2baaeb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.125621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e3ec8-abc1-40f4-b7d2-ae24ce2baaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.157072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d31e3ec8-abc1-40f4-b7d2-ae24ce2baaeb None None] MFA Rules not processed for user `aa1c5656781f4358b1999bfd7d5a2c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:48.158497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d31e3ec8-abc1-40f4-b7d2-ae24ce2baaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.202528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1097/2203] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:48 2022] PUT /identity/v3/projects/4f59e93c39574a5ead24df091d959eae/users/52a0bc7bca214a6cbab78e5a1d122be2/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:48.203658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:48.205166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.233507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1107/2204] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:48.235115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221448f7-8c4e-4bb1-a7ef-7b909dbb9fef None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.235407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221448f7-8c4e-4bb1-a7ef-7b909dbb9fef None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.235681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221448f7-8c4e-4bb1-a7ef-7b909dbb9fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.262629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-221448f7-8c4e-4bb1-a7ef-7b909dbb9fef None None] MFA Rules not processed for user `52a0bc7bca214a6cbab78e5a1d122be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:48.263845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-221448f7-8c4e-4bb1-a7ef-7b909dbb9fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.279213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ad9f3-e97c-41f5-8eaf-5af863ee53a7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:48.283935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:48.284856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.285074 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.285543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.333499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1108/2205] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:48.340817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221448f7-8c4e-4bb1-a7ef-7b909dbb9fef None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:48.344512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-221448f7-8c4e-4bb1-a7ef-7b909dbb9fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.354361 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:48.355855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:48.368029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1098/2206] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:48.369049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:48.370481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.409602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221448f7-8c4e-4bb1-a7ef-7b909dbb9fef None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:48.413757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ff467-de25-4c1e-93c3-e97eb479f01e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:48.414463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff467-de25-4c1e-93c3-e97eb479f01e service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.414747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff467-de25-4c1e-93c3-e97eb479f01e service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.420901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff467-de25-4c1e-93c3-e97eb479f01e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.436685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5051d-9439-4f64-924e-393605b27fc4 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:48.440859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:48.449665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.449665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.449665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.453494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:48.456129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:48.471990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1099/2207] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:48.487359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ff467-de25-4c1e-93c3-e97eb479f01e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:48.488987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ff467-de25-4c1e-93c3-e97eb479f01e service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:48.499450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1109/2208] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:48.730185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:48.813474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:48.813474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.828876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a73c9-d691-4553-98ac-4aa98b90cfb1 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:48.833891 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:48.834766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.835055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.835332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] PATH_INFO: `/v3/projects/a443eae376bb4c15846c5dd0312dc733` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.836667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a443eae376bb4c15846c5dd0312dc733)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:48.844600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:48.900174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ff467-de25-4c1e-93c3-e97eb479f01e service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:48.911270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ff467-de25-4c1e-93c3-e97eb479f01e service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:48.915022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:48.915673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:48.915982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:48.916260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:48.918173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:48.977975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a443eae376bb4c15846c5dd0312dc733', 'request_id': 'req-ff1c3816-8594-459e-9f4d-c950c08fb1f4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:48.982617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:48.984051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:48.986061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a443eae376bb4c15846c5dd0312dc733', 'request_id': 'req-ff1c3816-8594-459e-9f4d-c950c08fb1f4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:48.993812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1110/2209] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:49.004554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a443eae376bb4c15846c5dd0312dc733', 'request_id': 'req-ff1c3816-8594-459e-9f4d-c950c08fb1f4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:49.065445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] The token cache is being invalidate because project a443eae376bb4c15846c5dd0312dc733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:49.067358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:49.067358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:49.068054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1100/2210] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:48 2022] DELETE /identity/v3/projects/a443eae376bb4c15846c5dd0312dc733 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:49.072201 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:49.085032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f49c3-fe46-490d-90a2-c983f23662bc service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:49.149080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:49.150131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:49.150404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:49.150831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] PATH_INFO: `/v3/users/375c87fffa684b2eb53403853a133d4e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:49.152030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375c87fffa684b2eb53403853a133d4e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:49.154641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:49.404633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375c87fffa684b2eb53403853a133d4e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:49.411530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375c87fffa684b2eb53403853a133d4e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:49.504970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375c87fffa684b2eb53403853a133d4e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:49.505557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375c87fffa684b2eb53403853a133d4e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:49.519790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375c87fffa684b2eb53403853a133d4e'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:49.526006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1111/2211] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:49 2022] DELETE /identity/v3/users/375c87fffa684b2eb53403853a133d4e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:49.609008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:49.719555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:49.721161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:49.736341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c3816-8594-459e-9f4d-c950c08fb1f4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:49.801734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:49.802605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:49.802886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:49.803165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] PATH_INFO: `/v3/users/94db038cce364dd487ee170a4e1c8ad0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:49.804415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=94db038cce364dd487ee170a4e1c8ad0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:49.806429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:49.972076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:49.975459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:49.993855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a5ba0-fc06-489f-a2ca-348dd9725dd5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.000343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94db038cce364dd487ee170a4e1c8ad0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.006110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.006990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.007274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.007646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] PATH_INFO: `/v3/projects/38707bde1064405aa6266ebb6fb9cc1b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.008887 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38707bde1064405aa6266ebb6fb9cc1b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.011079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.065153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94db038cce364dd487ee170a4e1c8ad0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.077480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94db038cce364dd487ee170a4e1c8ad0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.078176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94db038cce364dd487ee170a4e1c8ad0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.084946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dffcb1fd-3601-49ce-bd5a-9c8052219ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94db038cce364dd487ee170a4e1c8ad0'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.091051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1101/2212] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:49 2022] DELETE /identity/v3/users/94db038cce364dd487ee170a4e1c8ad0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:50.096237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df26d66-0693-4aea-8d6b-af9fd8a81487 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.096237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df26d66-0693-4aea-8d6b-af9fd8a81487 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.096533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df26d66-0693-4aea-8d6b-af9fd8a81487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.119845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7df26d66-0693-4aea-8d6b-af9fd8a81487 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:50.121118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7df26d66-0693-4aea-8d6b-af9fd8a81487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.123763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38707bde1064405aa6266ebb6fb9cc1b', 'request_id': 'req-dff6e3fd-4993-4905-8ccc-144bc93387a3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.134306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38707bde1064405aa6266ebb6fb9cc1b', 'request_id': 'req-dff6e3fd-4993-4905-8ccc-144bc93387a3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.143819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38707bde1064405aa6266ebb6fb9cc1b', 'request_id': 'req-dff6e3fd-4993-4905-8ccc-144bc93387a3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.183376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1102/2213] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:50.192830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df26d66-0693-4aea-8d6b-af9fd8a81487 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.194171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7df26d66-0693-4aea-8d6b-af9fd8a81487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.236855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] The token cache is being invalidate because project 38707bde1064405aa6266ebb6fb9cc1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:50.237312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.238450 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-dff6e3fd-4993-4905-8ccc-144bc93387a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.240297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1112/2214] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:49 2022] DELETE /identity/v3/projects/38707bde1064405aa6266ebb6fb9cc1b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:50.244969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86a40-8f0d-4307-81eb-644be3d5b361 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.245367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86a40-8f0d-4307-81eb-644be3d5b361 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.245633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86a40-8f0d-4307-81eb-644be3d5b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.252857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df26d66-0693-4aea-8d6b-af9fd8a81487 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.256611 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.257286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.257710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.257995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.259838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.263667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fdd86a40-8f0d-4307-81eb-644be3d5b361 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:50.264865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fdd86a40-8f0d-4307-81eb-644be3d5b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.272504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.272795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1113/2215] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:50.274042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.281262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ce45-c7b9-45cc-ba62-e30c2a41d7c6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.281262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ce45-c7b9-45cc-ba62-e30c2a41d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.281474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ce45-c7b9-45cc-ba62-e30c2a41d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.284574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1103/2216] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:50.300113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-2c97ce45-c7b9-45cc-ba62-e30c2a41d7c6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:50.301399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2c97ce45-c7b9-45cc-ba62-e30c2a41d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.309780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1114/2217] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:50.314202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.323625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94441097-8fef-4c3f-b470-50dffbdebfbc service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.328904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.329553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.329834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.330110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.330931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:50.331239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.332855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.345154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1104/2218] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:50.349590 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ce45-c7b9-45cc-ba62-e30c2a41d7c6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.359013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ce45-c7b9-45cc-ba62-e30c2a41d7c6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.363776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.364465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.364749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.365056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.365744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.367646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.467563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1115/2219] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:50.471733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.481905 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f49b7-9d02-4392-bba2-10bbbfe4dc8d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.532167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.534044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.540438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6fdda-c6ef-491a-9f4b-0398895da84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.541301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fdda-c6ef-491a-9f4b-0398895da84f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.541596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fdda-c6ef-491a-9f4b-0398895da84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.541872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6fdda-c6ef-491a-9f4b-0398895da84f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.542580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6fdda-c6ef-491a-9f4b-0398895da84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.544567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6fdda-c6ef-491a-9f4b-0398895da84f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.549535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:50.599811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda2508-5740-451f-ba7d-781d3acd87c5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.604597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.605444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.605723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.605997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] PATH_INFO: `/v3/projects/c44c4f14b5f04c2aa6585ac5d3b2d2a8` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.607239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44c4f14b5f04c2aa6585ac5d3b2d2a8)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.609265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.621766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1105/2220] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:50.625944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6fdda-c6ef-491a-9f4b-0398895da84f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.636044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6fdda-c6ef-491a-9f4b-0398895da84f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.641208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf792c7-afa8-489f-bfeb-fd1195ade3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.641858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf792c7-afa8-489f-bfeb-fd1195ade3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.642177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf792c7-afa8-489f-bfeb-fd1195ade3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.642460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf792c7-afa8-489f-bfeb-fd1195ade3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.643188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf792c7-afa8-489f-bfeb-fd1195ade3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.644805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf792c7-afa8-489f-bfeb-fd1195ade3fd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.655290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1106/2221] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:50.659003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf792c7-afa8-489f-bfeb-fd1195ade3fd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.668492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf792c7-afa8-489f-bfeb-fd1195ade3fd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.673035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815073d-90e3-45d9-9937-baf5a9643ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.673647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815073d-90e3-45d9-9937-baf5a9643ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.673931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815073d-90e3-45d9-9937-baf5a9643ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.674209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815073d-90e3-45d9-9937-baf5a9643ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.674911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815073d-90e3-45d9-9937-baf5a9643ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.676547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815073d-90e3-45d9-9937-baf5a9643ba3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.684559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:50.687248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1107/2222] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:50.691152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815073d-90e3-45d9-9937-baf5a9643ba3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.701370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815073d-90e3-45d9-9937-baf5a9643ba3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.706029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65423b61-5c34-46ae-8886-b2d911b79958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.706871 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65423b61-5c34-46ae-8886-b2d911b79958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.707151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65423b61-5c34-46ae-8886-b2d911b79958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.707426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65423b61-5c34-46ae-8886-b2d911b79958 admin admin] PATH_INFO: `/v3/projects/6356d2b580774c4d9a11a342a0020a37/users/695659ceb542488885e961c577e30f0c/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.722083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65423b61-5c34-46ae-8886-b2d911b79958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6356d2b580774c4d9a11a342a0020a37, user_id=695659ceb542488885e961c577e30f0c, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.723931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'request_id': 'req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.724812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65423b61-5c34-46ae-8886-b2d911b79958 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.729603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'request_id': 'req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.737864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44c4f14b5f04c2aa6585ac5d3b2d2a8', 'request_id': 'req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.792644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1108/2223] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:50 2022] PUT /identity/v3/projects/6356d2b580774c4d9a11a342a0020a37/users/695659ceb542488885e961c577e30f0c/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:50.802877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd26fea-6d01-49b6-ae86-417c149ceaa7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.803204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd26fea-6d01-49b6-ae86-417c149ceaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.803481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd26fea-6d01-49b6-ae86-417c149ceaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.815795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] The token cache is being invalidate because project c44c4f14b5f04c2aa6585ac5d3b2d2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:50.816193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.816914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab0c7215-4031-4dbc-a7d9-4744ccf8a299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:50.818544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1116/2224] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:50 2022] DELETE /identity/v3/projects/c44c4f14b5f04c2aa6585ac5d3b2d2a8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:50.823168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731da21-6a4b-440e-9701-c0da0c49195c None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.823461 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731da21-6a4b-440e-9701-c0da0c49195c None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.823744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731da21-6a4b-440e-9701-c0da0c49195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.833121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4fd26fea-6d01-49b6-ae86-417c149ceaa7 None None] MFA Rules not processed for user `695659ceb542488885e961c577e30f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:50.834315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4fd26fea-6d01-49b6-ae86-417c149ceaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.842039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e731da21-6a4b-440e-9701-c0da0c49195c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:50.843209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e731da21-6a4b-440e-9701-c0da0c49195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.898468 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1109/2225] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:50.902899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd26fea-6d01-49b6-ae86-417c149ceaa7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.904199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1117/2226] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:50.904314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4fd26fea-6d01-49b6-ae86-417c149ceaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.913808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92cdb-4547-4ba6-a39a-2ba383c49eaa None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.914093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92cdb-4547-4ba6-a39a-2ba383c49eaa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.914370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc92cdb-4547-4ba6-a39a-2ba383c49eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.917457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd26fea-6d01-49b6-ae86-417c149ceaa7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.923002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1e05b-0f9b-400c-bbb0-9b0a434e607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.925816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1e05b-0f9b-400c-bbb0-9b0a434e607d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.925816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1e05b-0f9b-400c-bbb0-9b0a434e607d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.925816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1e05b-0f9b-400c-bbb0-9b0a434e607d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.925816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1e05b-0f9b-400c-bbb0-9b0a434e607d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.926943 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1e05b-0f9b-400c-bbb0-9b0a434e607d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.931898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-efc92cdb-4547-4ba6-a39a-2ba383c49eaa None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:50.933100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-efc92cdb-4547-4ba6-a39a-2ba383c49eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:50.942344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1118/2227] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:50.946515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc92cdb-4547-4ba6-a39a-2ba383c49eaa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.955802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc92cdb-4547-4ba6-a39a-2ba383c49eaa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:50.960455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:50.961082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:50.964375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:50.964375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:50.964375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:50.964375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:50.964375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:50.978853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1119/2228] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:50.979822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.985248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1110/2229] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:50.986300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1e05b-0f9b-400c-bbb0-9b0a434e607d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:50.990793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45570836-01a0-4dd4-b61a-7111d6c0b07b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.051433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf19a0b-55a9-4cbf-b41c-c6fb891c201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.052677 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19a0b-55a9-4cbf-b41c-c6fb891c201f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.053204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19a0b-55a9-4cbf-b41c-c6fb891c201f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.054357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19a0b-55a9-4cbf-b41c-c6fb891c201f admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.054996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf19a0b-55a9-4cbf-b41c-c6fb891c201f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.058410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf19a0b-55a9-4cbf-b41c-c6fb891c201f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.060868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1e05b-0f9b-400c-bbb0-9b0a434e607d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.068297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc925786-ac59-4de9-a679-88d187410e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.069354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc925786-ac59-4de9-a679-88d187410e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.069879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc925786-ac59-4de9-a679-88d187410e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.070337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc925786-ac59-4de9-a679-88d187410e20 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.071621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc925786-ac59-4de9-a679-88d187410e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.074035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc925786-ac59-4de9-a679-88d187410e20 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.107851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:51.154468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1120/2230] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:51.158238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf19a0b-55a9-4cbf-b41c-c6fb891c201f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.177867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1111/2231] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:50 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:51.181715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc925786-ac59-4de9-a679-88d187410e20 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.191886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc925786-ac59-4de9-a679-88d187410e20 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.221840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf19a0b-55a9-4cbf-b41c-c6fb891c201f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.226559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bdeaf-516d-4810-ac63-519c97655ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.227223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bdeaf-516d-4810-ac63-519c97655ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.227510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bdeaf-516d-4810-ac63-519c97655ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.227789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bdeaf-516d-4810-ac63-519c97655ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.228511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bdeaf-516d-4810-ac63-519c97655ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.230473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bdeaf-516d-4810-ac63-519c97655ff0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.243404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:51.251211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f125ce-c582-405a-afbe-254dd66dec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.251880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f125ce-c582-405a-afbe-254dd66dec2c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.252195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f125ce-c582-405a-afbe-254dd66dec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.252492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f125ce-c582-405a-afbe-254dd66dec2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.253193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f125ce-c582-405a-afbe-254dd66dec2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.254806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f125ce-c582-405a-afbe-254dd66dec2c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.265106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1112/2232] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:51.269049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f125ce-c582-405a-afbe-254dd66dec2c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.278398 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f125ce-c582-405a-afbe-254dd66dec2c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.283042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf82fc-6c39-44e4-ab54-64280103975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.283881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf82fc-6c39-44e4-ab54-64280103975c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.284191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf82fc-6c39-44e4-ab54-64280103975c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.284470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf82fc-6c39-44e4-ab54-64280103975c admin admin] PATH_INFO: `/v3/projects/7ab56bb2f808496c83278aba959971df/users/af409291b73b4a16ae165f332fcda5c3/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.299030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf82fc-6c39-44e4-ab54-64280103975c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab56bb2f808496c83278aba959971df, user_id=af409291b73b4a16ae165f332fcda5c3, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.301766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf82fc-6c39-44e4-ab54-64280103975c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.346048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1121/2233] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:51 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:51.349941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bdeaf-516d-4810-ac63-519c97655ff0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.359585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bdeaf-516d-4810-ac63-519c97655ff0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.364238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67402dbf-406e-42ac-8474-466c43d441d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.364857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402dbf-406e-42ac-8474-466c43d441d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.365139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402dbf-406e-42ac-8474-466c43d441d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.365416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402dbf-406e-42ac-8474-466c43d441d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.366130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67402dbf-406e-42ac-8474-466c43d441d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.367699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67402dbf-406e-42ac-8474-466c43d441d7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.377725 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1122/2234] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:51.381353 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67402dbf-406e-42ac-8474-466c43d441d7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.391177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67402dbf-406e-42ac-8474-466c43d441d7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.395820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec528eb-df0a-4162-832d-e456b2e580a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.396480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec528eb-df0a-4162-832d-e456b2e580a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.396766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec528eb-df0a-4162-832d-e456b2e580a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.397210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec528eb-df0a-4162-832d-e456b2e580a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.397924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec528eb-df0a-4162-832d-e456b2e580a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.399552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec528eb-df0a-4162-832d-e456b2e580a0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.409658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1123/2235] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:51.413782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec528eb-df0a-4162-832d-e456b2e580a0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.420671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1113/2236] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:51 2022] PUT /identity/v3/projects/7ab56bb2f808496c83278aba959971df/users/af409291b73b4a16ae165f332fcda5c3/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:51.424815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf82fc-6c39-44e4-ab54-64280103975c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.425378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec528eb-df0a-4162-832d-e456b2e580a0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.480496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9581a47-7ce1-47d5-8a7a-7723f501a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.481520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581a47-7ce1-47d5-8a7a-7723f501a673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.481950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581a47-7ce1-47d5-8a7a-7723f501a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.482734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9581a47-7ce1-47d5-8a7a-7723f501a673 admin admin] PATH_INFO: `/v3/projects/4020df94dce44ce6bfe88478e6efa55f/users/7488c1659ed64e9bb4c28a7284578d29/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.485453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf82fc-6c39-44e4-ab54-64280103975c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.490099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45041d-44c8-4e06-830c-8219364ad5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.490767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45041d-44c8-4e06-830c-8219364ad5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.491046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45041d-44c8-4e06-830c-8219364ad5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.491326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45041d-44c8-4e06-830c-8219364ad5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.492094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45041d-44c8-4e06-830c-8219364ad5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.493680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45041d-44c8-4e06-830c-8219364ad5c5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.497067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9581a47-7ce1-47d5-8a7a-7723f501a673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4020df94dce44ce6bfe88478e6efa55f, user_id=7488c1659ed64e9bb4c28a7284578d29, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.499815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9581a47-7ce1-47d5-8a7a-7723f501a673 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.503460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1114/2237] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:51.507481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45041d-44c8-4e06-830c-8219364ad5c5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.517101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45041d-44c8-4e06-830c-8219364ad5c5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.521726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffb9cc-6438-4d07-af73-675f552c5981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.522568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffb9cc-6438-4d07-af73-675f552c5981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.522850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffb9cc-6438-4d07-af73-675f552c5981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.523137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffb9cc-6438-4d07-af73-675f552c5981 admin admin] PATH_INFO: `/v3/projects/7ab56bb2f808496c83278aba959971df/users/af409291b73b4a16ae165f332fcda5c3/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.525093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffb9cc-6438-4d07-af73-675f552c5981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab56bb2f808496c83278aba959971df, user_id=af409291b73b4a16ae165f332fcda5c3, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.527746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffb9cc-6438-4d07-af73-675f552c5981 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.538305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1115/2238] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:51 2022] PUT /identity/v3/projects/7ab56bb2f808496c83278aba959971df/users/af409291b73b4a16ae165f332fcda5c3/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:51.549630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a50cb-6c95-4c37-bac3-2433bd70a303 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.549920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a50cb-6c95-4c37-bac3-2433bd70a303 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.550196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a50cb-6c95-4c37-bac3-2433bd70a303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.576933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-576a50cb-6c95-4c37-bac3-2433bd70a303 None None] MFA Rules not processed for user `af409291b73b4a16ae165f332fcda5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:51.578068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-576a50cb-6c95-4c37-bac3-2433bd70a303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:51.599061 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1124/2239] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:51 2022] PUT /identity/v3/projects/4020df94dce44ce6bfe88478e6efa55f/users/7488c1659ed64e9bb4c28a7284578d29/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:51.604259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6390-6439-40b6-92e2-6ff61148b9a7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.604549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6390-6439-40b6-92e2-6ff61148b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.604821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6390-6439-40b6-92e2-6ff61148b9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.621734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-60ed6390-6439-40b6-92e2-6ff61148b9a7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:51.623002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-60ed6390-6439-40b6-92e2-6ff61148b9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:51.647326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1116/2240] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:51.660119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a50cb-6c95-4c37-bac3-2433bd70a303 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.661499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-576a50cb-6c95-4c37-bac3-2433bd70a303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:51.681564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1125/2241] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:51.691014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6390-6439-40b6-92e2-6ff61148b9a7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:51.692408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-60ed6390-6439-40b6-92e2-6ff61148b9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:51.718562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a50cb-6c95-4c37-bac3-2433bd70a303 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.755425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6390-6439-40b6-92e2-6ff61148b9a7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:51.759891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a240d-72fa-4a8b-8d78-acb4bac1212a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.760855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a240d-72fa-4a8b-8d78-acb4bac1212a service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.761143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a240d-72fa-4a8b-8d78-acb4bac1212a service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.761422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a240d-72fa-4a8b-8d78-acb4bac1212a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.770821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a240d-72fa-4a8b-8d78-acb4bac1212a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.772318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a240d-72fa-4a8b-8d78-acb4bac1212a service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.772765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ced4-26f0-48f8-8331-c9411bca9144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:51.773413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ced4-26f0-48f8-8331-c9411bca9144 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:51.773694 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ced4-26f0-48f8-8331-c9411bca9144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:51.773973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09ced4-26f0-48f8-8331-c9411bca9144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:51.783177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1126/2242] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:51.785942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:51.831539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:51.837059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ced4-26f0-48f8-8331-c9411bca9144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:51.838690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09ced4-26f0-48f8-8331-c9411bca9144 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:51.848918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1117/2243] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:52.067520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:52.508487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:52.945215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a240d-72fa-4a8b-8d78-acb4bac1212a service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:52.956470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a240d-72fa-4a8b-8d78-acb4bac1212a service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:52.961360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af409291b73b4a16ae165f332fcda5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ab56bb2f808496c83278aba959971df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:52.962008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:52.962291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:52.962801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:52.963400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:52.963710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:52.965478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:52.985050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1127/2244] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:52.989816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ced4-26f0-48f8-8331-c9411bca9144 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:53.000775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09ced4-26f0-48f8-8331-c9411bca9144 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:53.005718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33a6e7-7344-4ed7-a3ac-e81100dac013 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af409291b73b4a16ae165f332fcda5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ab56bb2f808496c83278aba959971df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:53.009810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33a6e7-7344-4ed7-a3ac-e81100dac013 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:53.009810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33a6e7-7344-4ed7-a3ac-e81100dac013 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:53.009810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33a6e7-7344-4ed7-a3ac-e81100dac013 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:53.009810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33a6e7-7344-4ed7-a3ac-e81100dac013 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:53.010125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33a6e7-7344-4ed7-a3ac-e81100dac013 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:53.110581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1118/2245] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:52 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:53.115100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:53.126225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa887aaf-dbc9-4c36-8103-dcf567e39dfc tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:53.194458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af409291b73b4a16ae165f332fcda5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ab56bb2f808496c83278aba959971df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:53.195124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:53.195407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:53.195678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:53.196437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:53.196814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:53.198409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:53.224787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1128/2246] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:41:53.270203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33a6e7-7344-4ed7-a3ac-e81100dac013 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:53.283792 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33a6e7-7344-4ed7-a3ac-e81100dac013 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:53.299025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af409291b73b4a16ae165f332fcda5c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ab56bb2f808496c83278aba959971df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:53.299961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:53.300260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:53.300545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] PATH_INFO: `/v3/projects/d40b43fced0746119a14a436efbc678b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:53.301940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d40b43fced0746119a14a436efbc678b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:53.303873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:53.484982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40b43fced0746119a14a436efbc678b', 'request_id': 'req-7188cb48-60ec-4326-8e16-8d2a3cd48d51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:53.490353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40b43fced0746119a14a436efbc678b', 'request_id': 'req-7188cb48-60ec-4326-8e16-8d2a3cd48d51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:53.497093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40b43fced0746119a14a436efbc678b', 'request_id': 'req-7188cb48-60ec-4326-8e16-8d2a3cd48d51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:53.502191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:53.599259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] The token cache is being invalidate because project d40b43fced0746119a14a436efbc678b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:53.599609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:53.601434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7188cb48-60ec-4326-8e16-8d2a3cd48d51 tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:53.607890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1119/2247] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:53 2022] DELETE /identity/v3/projects/d40b43fced0746119a14a436efbc678b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:53.828320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:54.355932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:54.357763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:54.430818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0d4c-f448-4d41-89db-774b14a560fe tempest-VolumeQuotaClassesTest-2055830551 tempest-VolumeQuotaClassesTest-2055830551-project-admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:54.491975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:54.492770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:54.493053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:54.493320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] PATH_INFO: `/v3/users/695659ceb542488885e961c577e30f0c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:54.494839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] RBAC: Authorizing `identity:delete_user(user_id=695659ceb542488885e961c577e30f0c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:54.496848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:54.755222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695659ceb542488885e961c577e30f0c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:54.764040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695659ceb542488885e961c577e30f0c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:54.899502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695659ceb542488885e961c577e30f0c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:54.901013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695659ceb542488885e961c577e30f0c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:54.918955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695659ceb542488885e961c577e30f0c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:54.938089 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1129/2248] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:54 2022] DELETE /identity/v3/users/695659ceb542488885e961c577e30f0c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:54.942543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800050b-0f18-4083-b440-1e0c24d91120 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:54.943047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800050b-0f18-4083-b440-1e0c24d91120 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:54.943140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800050b-0f18-4083-b440-1e0c24d91120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:54.967267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3800050b-0f18-4083-b440-1e0c24d91120 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:54.969022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3800050b-0f18-4083-b440-1e0c24d91120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:54.988335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:55.068082 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1120/2249] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:55.068245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:55.071058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:55.149493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f72cde-44fe-42fa-aa90-7f2c5c50015d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:55.154080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80839a0a-899b-4935-a798-f8f39857ab95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:55.155361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839a0a-899b-4935-a798-f8f39857ab95 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:55.155726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839a0a-899b-4935-a798-f8f39857ab95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:55.156257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80839a0a-899b-4935-a798-f8f39857ab95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:55.166475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80839a0a-899b-4935-a798-f8f39857ab95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:55.167945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80839a0a-899b-4935-a798-f8f39857ab95 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:55.179946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1130/2250] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:55.248245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:55.687730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800050b-0f18-4083-b440-1e0c24d91120 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:55.689442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3800050b-0f18-4083-b440-1e0c24d91120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:55.703375 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800050b-0f18-4083-b440-1e0c24d91120 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:55.712065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:55.713876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:55.713876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:55.714154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] PATH_INFO: `/v3/projects/6356d2b580774c4d9a11a342a0020a37` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:55.715615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6356d2b580774c4d9a11a342a0020a37)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:55.718011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:55.835945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:55.865972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6356d2b580774c4d9a11a342a0020a37', 'request_id': 'req-7d44c0fb-9745-4fca-8c2b-c08401c93a80'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:55.875103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6356d2b580774c4d9a11a342a0020a37', 'request_id': 'req-7d44c0fb-9745-4fca-8c2b-c08401c93a80'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:55.882972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6356d2b580774c4d9a11a342a0020a37', 'request_id': 'req-7d44c0fb-9745-4fca-8c2b-c08401c93a80'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:55.959689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] The token cache is being invalidate because project 6356d2b580774c4d9a11a342a0020a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:55.960490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:55.962012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:55.971171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1121/2251] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:55 2022] DELETE /identity/v3/projects/6356d2b580774c4d9a11a342a0020a37 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:55.974007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80839a0a-899b-4935-a798-f8f39857ab95 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:55.986591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80839a0a-899b-4935-a798-f8f39857ab95 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:56.051793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:56.052749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:56.053033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:56.053306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] PATH_INFO: `/v3/users/af409291b73b4a16ae165f332fcda5c3` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:56.057238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af409291b73b4a16ae165f332fcda5c3)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:56.060476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:56.210806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:56.259589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af409291b73b4a16ae165f332fcda5c3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:56.268701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af409291b73b4a16ae165f332fcda5c3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:56.318272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af409291b73b4a16ae165f332fcda5c3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:56.319040 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af409291b73b4a16ae165f332fcda5c3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:56.334215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e42f7d27-0c36-448d-84a9-7bd83ca36212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af409291b73b4a16ae165f332fcda5c3'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:56.340376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1131/2252] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:41:55 2022] DELETE /identity/v3/users/af409291b73b4a16ae165f332fcda5c3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:56.825257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:56.827535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:56.844639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44c0fb-9745-4fca-8c2b-c08401c93a80 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:56.916204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:56.917144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:56.917419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:56.917698 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] PATH_INFO: `/v3/projects/7ab56bb2f808496c83278aba959971df` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:56.925047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab56bb2f808496c83278aba959971df)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:56.925047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:57.038625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab56bb2f808496c83278aba959971df', 'request_id': 'req-0564e01f-c52f-4cd6-8bd3-d3a065113c00'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:57.046437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab56bb2f808496c83278aba959971df', 'request_id': 'req-0564e01f-c52f-4cd6-8bd3-d3a065113c00'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:57.053274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab56bb2f808496c83278aba959971df', 'request_id': 'req-0564e01f-c52f-4cd6-8bd3-d3a065113c00'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:57.128834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] The token cache is being invalidate because project 7ab56bb2f808496c83278aba959971df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:41:57.129488 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:57.130261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0564e01f-c52f-4cd6-8bd3-d3a065113c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:41:57.131942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1122/2253] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:41:56 2022] DELETE /identity/v3/projects/7ab56bb2f808496c83278aba959971df => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:57.137177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a947-f9c1-44bc-9f3a-aea46b90e754 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.138032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a947-f9c1-44bc-9f3a-aea46b90e754 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.139063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a947-f9c1-44bc-9f3a-aea46b90e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.159815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6b59a947-f9c1-44bc-9f3a-aea46b90e754 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:57.161335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6b59a947-f9c1-44bc-9f3a-aea46b90e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:57.238998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1132/2254] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:57.246678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918358-5c46-41f6-9742-d17699e95a2b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.247209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918358-5c46-41f6-9742-d17699e95a2b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.247716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918358-5c46-41f6-9742-d17699e95a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.272381 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-37918358-5c46-41f6-9742-d17699e95a2b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:57.275553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-37918358-5c46-41f6-9742-d17699e95a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:57.285265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1123/2255] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:57.289294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59a947-f9c1-44bc-9f3a-aea46b90e754 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:57.314078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59a947-f9c1-44bc-9f3a-aea46b90e754 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:57.322203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:57.324340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.324982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.326808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.329836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:41:57.330717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:57.345830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:57.361542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1133/2256] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:41:57.366772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918358-5c46-41f6-9742-d17699e95a2b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:57.379532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918358-5c46-41f6-9742-d17699e95a2b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:57.387777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427b0f4-a69b-4a9e-a15a-7cb938dc2cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:57.388992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b0f4-a69b-4a9e-a15a-7cb938dc2cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.389671 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b0f4-a69b-4a9e-a15a-7cb938dc2cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.390188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427b0f4-a69b-4a9e-a15a-7cb938dc2cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.391318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427b0f4-a69b-4a9e-a15a-7cb938dc2cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:57.393674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427b0f4-a69b-4a9e-a15a-7cb938dc2cd2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:57.558868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1124/2257] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:57 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:41:57.563005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:57.573785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0627-e080-48f9-a7cd-e7c6515dc0c9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:57.616790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75213112-fbc4-4091-a060-76a039ca2111 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.617162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75213112-fbc4-4091-a060-76a039ca2111 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.617392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75213112-fbc4-4091-a060-76a039ca2111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.658308 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-75213112-fbc4-4091-a060-76a039ca2111 None None] MFA Rules not processed for user `7488c1659ed64e9bb4c28a7284578d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:57.661625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-75213112-fbc4-4091-a060-76a039ca2111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:57.666140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc70154-a112-4e03-9d2d-7f8c5949364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:57.667431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc70154-a112-4e03-9d2d-7f8c5949364d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.668045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc70154-a112-4e03-9d2d-7f8c5949364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.668465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc70154-a112-4e03-9d2d-7f8c5949364d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.669316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc70154-a112-4e03-9d2d-7f8c5949364d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:57.672393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc70154-a112-4e03-9d2d-7f8c5949364d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:57.750811 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1125/2258] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:57.755271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75213112-fbc4-4091-a060-76a039ca2111 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:57.756758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-75213112-fbc4-4091-a060-76a039ca2111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:57.770738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75213112-fbc4-4091-a060-76a039ca2111 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:57.776824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414284-82bd-4d86-a147-cbfd7231f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:57.777490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414284-82bd-4d86-a147-cbfd7231f995 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.778318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414284-82bd-4d86-a147-cbfd7231f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.778602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414284-82bd-4d86-a147-cbfd7231f995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.779298 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de414284-82bd-4d86-a147-cbfd7231f995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:57.782624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de414284-82bd-4d86-a147-cbfd7231f995 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:57.792442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1134/2259] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:57 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:57.797126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc70154-a112-4e03-9d2d-7f8c5949364d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:57.808253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc70154-a112-4e03-9d2d-7f8c5949364d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:57.813608 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dc90c-c4b3-4976-9240-c70fd93cfd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:57.814029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dc90c-c4b3-4976-9240-c70fd93cfd7e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.814553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dc90c-c4b3-4976-9240-c70fd93cfd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.814927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dc90c-c4b3-4976-9240-c70fd93cfd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.815794 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dc90c-c4b3-4976-9240-c70fd93cfd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:57.817488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dc90c-c4b3-4976-9240-c70fd93cfd7e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:57.829520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1135/2260] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:57.833328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dc90c-c4b3-4976-9240-c70fd93cfd7e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:57.845975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dc90c-c4b3-4976-9240-c70fd93cfd7e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:57.851373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1913e7-9f31-4616-bd26-153f8884412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:57.852245 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1913e7-9f31-4616-bd26-153f8884412e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.852685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1913e7-9f31-4616-bd26-153f8884412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.853427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1913e7-9f31-4616-bd26-153f8884412e admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.854373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1913e7-9f31-4616-bd26-153f8884412e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:57.854970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:57.856654 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1913e7-9f31-4616-bd26-153f8884412e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:57.867691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1136/2261] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:57.871889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1913e7-9f31-4616-bd26-153f8884412e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:57.881615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1913e7-9f31-4616-bd26-153f8884412e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:57.887607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74edcf3-9709-4ec7-8646-59f88d7070b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:57.888540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74edcf3-9709-4ec7-8646-59f88d7070b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.888826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74edcf3-9709-4ec7-8646-59f88d7070b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.889628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74edcf3-9709-4ec7-8646-59f88d7070b4 admin admin] PATH_INFO: `/v3/projects/80f3dbd15a0947cfa660f7f3c15975bc/users/1b1c1b5eb3ee46329f38f16e8af660fb/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.892915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1126/2262] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:57 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:57.896855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414284-82bd-4d86-a147-cbfd7231f995 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:57.907249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74edcf3-9709-4ec7-8646-59f88d7070b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f3dbd15a0947cfa660f7f3c15975bc, user_id=1b1c1b5eb3ee46329f38f16e8af660fb, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:57.910076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74edcf3-9709-4ec7-8646-59f88d7070b4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:57.964983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414284-82bd-4d86-a147-cbfd7231f995 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:57.972111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da14c-411c-43a7-b515-eb99ea510ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:57.974505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da14c-411c-43a7-b515-eb99ea510ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:57.974977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da14c-411c-43a7-b515-eb99ea510ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:57.975413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da14c-411c-43a7-b515-eb99ea510ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:57.976161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297da14c-411c-43a7-b515-eb99ea510ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:57.978464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297da14c-411c-43a7-b515-eb99ea510ea0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.000409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1137/2263] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:57 2022] PUT /identity/v3/projects/80f3dbd15a0947cfa660f7f3c15975bc/users/1b1c1b5eb3ee46329f38f16e8af660fb/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:58.011496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469adc-b45f-44fd-8fed-2a3a258f10b6 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.012062 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469adc-b45f-44fd-8fed-2a3a258f10b6 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.012488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469adc-b45f-44fd-8fed-2a3a258f10b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.047431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-e2469adc-b45f-44fd-8fed-2a3a258f10b6 None None] MFA Rules not processed for user `1b1c1b5eb3ee46329f38f16e8af660fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:58.049082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e2469adc-b45f-44fd-8fed-2a3a258f10b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:58.106254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1127/2264] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:57 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:58.108164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da14c-411c-43a7-b515-eb99ea510ea0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.122093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da14c-411c-43a7-b515-eb99ea510ea0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.148930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1138/2265] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:58.153533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2469adc-b45f-44fd-8fed-2a3a258f10b6 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.189650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc183-924e-40f5-af40-f5aefcfe24b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.190333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc183-924e-40f5-af40-f5aefcfe24b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.190529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:58.190633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc183-924e-40f5-af40-f5aefcfe24b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.192855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dc183-924e-40f5-af40-f5aefcfe24b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.192855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc183-924e-40f5-af40-f5aefcfe24b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.196276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dc183-924e-40f5-af40-f5aefcfe24b9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.204508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1128/2266] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:58.208597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc183-924e-40f5-af40-f5aefcfe24b9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.219405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dc183-924e-40f5-af40-f5aefcfe24b9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.225206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2469adc-b45f-44fd-8fed-2a3a258f10b6 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.225368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdaab6-b7b2-4a52-9240-2f2ea2904e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.225368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdaab6-b7b2-4a52-9240-2f2ea2904e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.225800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdaab6-b7b2-4a52-9240-2f2ea2904e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.226012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1daf98-9684-4a91-ba78-a19d5f36509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.226276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdaab6-b7b2-4a52-9240-2f2ea2904e5f admin admin] PATH_INFO: `/v3/projects/a6d0f38eca6c41eb885bb9bb14d570d8/users/69b1e491e65c4c0791623039f3ae4d0d/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.226663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1daf98-9684-4a91-ba78-a19d5f36509a admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.226943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1daf98-9684-4a91-ba78-a19d5f36509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.227216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1daf98-9684-4a91-ba78-a19d5f36509a admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.227914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1daf98-9684-4a91-ba78-a19d5f36509a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.229871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1daf98-9684-4a91-ba78-a19d5f36509a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.243306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdaab6-b7b2-4a52-9240-2f2ea2904e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d0f38eca6c41eb885bb9bb14d570d8, user_id=69b1e491e65c4c0791623039f3ae4d0d, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.246251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdaab6-b7b2-4a52-9240-2f2ea2904e5f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.341008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1129/2267] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:58 2022] PUT /identity/v3/projects/a6d0f38eca6c41eb885bb9bb14d570d8/users/69b1e491e65c4c0791623039f3ae4d0d/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:58.343010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1139/2268] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:41:58 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:58.345117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdaab6-b7b2-4a52-9240-2f2ea2904e5f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.346889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1daf98-9684-4a91-ba78-a19d5f36509a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.416356 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1daf98-9684-4a91-ba78-a19d5f36509a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.416522 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdaab6-b7b2-4a52-9240-2f2ea2904e5f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.422179 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30b517-bf7f-413f-a65a-592f75498de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.427453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774d618-fa09-4399-8141-3895c70d7763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.427644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30b517-bf7f-413f-a65a-592f75498de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.427742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774d618-fa09-4399-8141-3895c70d7763 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.427829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30b517-bf7f-413f-a65a-592f75498de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.427829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30b517-bf7f-413f-a65a-592f75498de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.428023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774d618-fa09-4399-8141-3895c70d7763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.428023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774d618-fa09-4399-8141-3895c70d7763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.428177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30b517-bf7f-413f-a65a-592f75498de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.428259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774d618-fa09-4399-8141-3895c70d7763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.428339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30b517-bf7f-413f-a65a-592f75498de9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.428430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774d618-fa09-4399-8141-3895c70d7763 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.442702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1130/2269] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:41:58.446719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774d618-fa09-4399-8141-3895c70d7763 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.457649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774d618-fa09-4399-8141-3895c70d7763 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.462899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f098d-dd42-416c-a6c7-ab10c32b9c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.463940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f098d-dd42-416c-a6c7-ab10c32b9c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.464314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f098d-dd42-416c-a6c7-ab10c32b9c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.464666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f098d-dd42-416c-a6c7-ab10c32b9c45 admin admin] PATH_INFO: `/v3/projects/a6d0f38eca6c41eb885bb9bb14d570d8/users/69b1e491e65c4c0791623039f3ae4d0d/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.466915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f098d-dd42-416c-a6c7-ab10c32b9c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d0f38eca6c41eb885bb9bb14d570d8, user_id=69b1e491e65c4c0791623039f3ae4d0d, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.471957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f098d-dd42-416c-a6c7-ab10c32b9c45 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.482888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1131/2270] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:58 2022] PUT /identity/v3/projects/a6d0f38eca6c41eb885bb9bb14d570d8/users/69b1e491e65c4c0791623039f3ae4d0d/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:41:58.531945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1140/2271] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:41:58 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:41:58.533626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f098d-dd42-416c-a6c7-ab10c32b9c45 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.619457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f098d-dd42-416c-a6c7-ab10c32b9c45 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.631327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a906-7eba-49a2-a1c0-4af590566c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.632044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a906-7eba-49a2-a1c0-4af590566c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.632457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a906-7eba-49a2-a1c0-4af590566c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.632736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a906-7eba-49a2-a1c0-4af590566c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.633461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0a906-7eba-49a2-a1c0-4af590566c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.635191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0a906-7eba-49a2-a1c0-4af590566c84 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.661489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1132/2272] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:58.662892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30b517-bf7f-413f-a65a-592f75498de9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.676249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30b517-bf7f-413f-a65a-592f75498de9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.681537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e5d53-ff94-41a0-9e4b-7c14eee0949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.682495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e5d53-ff94-41a0-9e4b-7c14eee0949d admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.682881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e5d53-ff94-41a0-9e4b-7c14eee0949d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.683190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e5d53-ff94-41a0-9e4b-7c14eee0949d admin admin] PATH_INFO: `/v3/projects/c3f7f4b0149b4ceeb84e4958266f1901/users/994da5598a1e47d2a5b47464b179fa1b/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.698889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e5d53-ff94-41a0-9e4b-7c14eee0949d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f7f4b0149b4ceeb84e4958266f1901, user_id=994da5598a1e47d2a5b47464b179fa1b, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.702405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e5d53-ff94-41a0-9e4b-7c14eee0949d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.821324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1141/2273] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:58 2022] PUT /identity/v3/projects/c3f7f4b0149b4ceeb84e4958266f1901/users/994da5598a1e47d2a5b47464b179fa1b/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:58.825208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a906-7eba-49a2-a1c0-4af590566c84 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.835580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a906-7eba-49a2-a1c0-4af590566c84 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.903266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af3c2-32c1-4f04-a973-e2a5e7e741e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.903979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af3c2-32c1-4f04-a973-e2a5e7e741e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.904348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af3c2-32c1-4f04-a973-e2a5e7e741e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.909719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af3c2-32c1-4f04-a973-e2a5e7e741e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.909719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60af3c2-32c1-4f04-a973-e2a5e7e741e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.909719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60af3c2-32c1-4f04-a973-e2a5e7e741e8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.919592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1133/2274] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:41:58.923631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e5d53-ff94-41a0-9e4b-7c14eee0949d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:58.934713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e5d53-ff94-41a0-9e4b-7c14eee0949d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:58.940294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:58.941220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.941504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.944429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] PATH_INFO: `/v3/projects/c3f7f4b0149b4ceeb84e4958266f1901/users/994da5598a1e47d2a5b47464b179fa1b/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.944429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f7f4b0149b4ceeb84e4958266f1901, user_id=994da5598a1e47d2a5b47464b179fa1b, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:58.946504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:58.960247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1142/2275] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:41:58 2022] PUT /identity/v3/projects/c3f7f4b0149b4ceeb84e4958266f1901/users/994da5598a1e47d2a5b47464b179fa1b/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:41:58.971592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978890-227c-4612-a570-cf2a3ee38bb4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:58.973100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978890-227c-4612-a570-cf2a3ee38bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:58.973100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978890-227c-4612-a570-cf2a3ee38bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:58.998246 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-aa978890-227c-4612-a570-cf2a3ee38bb4 None None] MFA Rules not processed for user `994da5598a1e47d2a5b47464b179fa1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:59.000069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aa978890-227c-4612-a570-cf2a3ee38bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:59.086143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1134/2276] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:41:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:59.103491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:59.109462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:59.189498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e4a87-8067-464b-bc25-ef50a0bb1200 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:59.194464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7587-5074-4581-a609-b07b503c70eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:59.195112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7587-5074-4581-a609-b07b503c70eb service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:59.195391 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7587-5074-4581-a609-b07b503c70eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:59.195665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7587-5074-4581-a609-b07b503c70eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:59.206066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced7587-5074-4581-a609-b07b503c70eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:59.207509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced7587-5074-4581-a609-b07b503c70eb service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:59.217495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1143/2277] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:59.398062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978890-227c-4612-a570-cf2a3ee38bb4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:59.411280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978890-227c-4612-a570-cf2a3ee38bb4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:59.417046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a16869-d53d-44ac-9030-97d025a34ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:59.418545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16869-d53d-44ac-9030-97d025a34ddc service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:59.419024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16869-d53d-44ac-9030-97d025a34ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:59.419498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16869-d53d-44ac-9030-97d025a34ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:59.517271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a16869-d53d-44ac-9030-97d025a34ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:59.519728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a16869-d53d-44ac-9030-97d025a34ddc service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:59.533271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1135/2278] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:00.307394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:00.818192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:00.984001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7587-5074-4581-a609-b07b503c70eb service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:01.081020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7587-5074-4581-a609-b07b503c70eb service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:01.087267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:01.088317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:01.088606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:01.088884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] PATH_INFO: `/v3/users/1b1c1b5eb3ee46329f38f16e8af660fb` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:01.090835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1c1b5eb3ee46329f38f16e8af660fb)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:01.092917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:01.315498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1c1b5eb3ee46329f38f16e8af660fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:01.323959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1c1b5eb3ee46329f38f16e8af660fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:01.443984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1c1b5eb3ee46329f38f16e8af660fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:01.445331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1c1b5eb3ee46329f38f16e8af660fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:01.458742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1c1b5eb3ee46329f38f16e8af660fb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:01.465491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1144/2279] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:00 2022] DELETE /identity/v3/users/1b1c1b5eb3ee46329f38f16e8af660fb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:01.471084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93821-ff68-4f88-ab33-23ceedc0f7a8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:01.471084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93821-ff68-4f88-ab33-23ceedc0f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:01.471725 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93821-ff68-4f88-ab33-23ceedc0f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:01.499874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-11d93821-ff68-4f88-ab33-23ceedc0f7a8 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:01.501135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11d93821-ff68-4f88-ab33-23ceedc0f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:01.593177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1136/2280] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:01.608235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:01.609714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:01.686472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e726be7-b45f-444f-9f0a-85094820ac0e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:01.694467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be54f-8bef-4f30-99b7-434135d7d5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:01.695385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be54f-8bef-4f30-99b7-434135d7d5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:01.699239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be54f-8bef-4f30-99b7-434135d7d5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:01.699239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be54f-8bef-4f30-99b7-434135d7d5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:01.707171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be54f-8bef-4f30-99b7-434135d7d5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:01.708908 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be54f-8bef-4f30-99b7-434135d7d5a8 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:01.721141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1145/2281] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:01.902249 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:02.455795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:02.736773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d93821-ff68-4f88-ab33-23ceedc0f7a8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:02.738628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11d93821-ff68-4f88-ab33-23ceedc0f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:02.841493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d93821-ff68-4f88-ab33-23ceedc0f7a8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:02.841493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:02.841493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:02.841493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:02.845866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] PATH_INFO: `/v3/projects/80f3dbd15a0947cfa660f7f3c15975bc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:02.845866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f3dbd15a0947cfa660f7f3c15975bc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:02.845866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:02.891191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:02.954646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f3dbd15a0947cfa660f7f3c15975bc', 'request_id': 'req-344c9162-60bf-4540-85cc-efc85eb644a3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:02.967577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f3dbd15a0947cfa660f7f3c15975bc', 'request_id': 'req-344c9162-60bf-4540-85cc-efc85eb644a3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:02.975061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f3dbd15a0947cfa660f7f3c15975bc', 'request_id': 'req-344c9162-60bf-4540-85cc-efc85eb644a3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:03.077337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] The token cache is being invalidate because project 80f3dbd15a0947cfa660f7f3c15975bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:03.077337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:03.077337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:03.077337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1137/2282] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:02 2022] DELETE /identity/v3/projects/80f3dbd15a0947cfa660f7f3c15975bc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:03.078339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be54f-8bef-4f30-99b7-434135d7d5a8 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:03.078339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be54f-8bef-4f30-99b7-434135d7d5a8 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:03.141304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:03.142472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:03.142855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:03.143235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] PATH_INFO: `/v3/users/994da5598a1e47d2a5b47464b179fa1b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:03.144754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=994da5598a1e47d2a5b47464b179fa1b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:03.146903 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:03.374241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994da5598a1e47d2a5b47464b179fa1b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:03.384343 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994da5598a1e47d2a5b47464b179fa1b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:03.457143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994da5598a1e47d2a5b47464b179fa1b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:03.468383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994da5598a1e47d2a5b47464b179fa1b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:03.509617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-13b29e96-04a4-47dc-bc8c-cb9da264aae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994da5598a1e47d2a5b47464b179fa1b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:03.525581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1146/2283] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:03 2022] DELETE /identity/v3/users/994da5598a1e47d2a5b47464b179fa1b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:04.033699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:04.276335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:04.277739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:04.291350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c9162-60bf-4540-85cc-efc85eb644a3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:04.363143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:04.364888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:04.365445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:04.365973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] PATH_INFO: `/v3/projects/c3f7f4b0149b4ceeb84e4958266f1901` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:04.367740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f7f4b0149b4ceeb84e4958266f1901)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:04.370237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:04.469024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f7f4b0149b4ceeb84e4958266f1901', 'request_id': 'req-93c78ddd-77ce-403e-b9fc-d3a5643913d9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:04.474961 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f7f4b0149b4ceeb84e4958266f1901', 'request_id': 'req-93c78ddd-77ce-403e-b9fc-d3a5643913d9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:04.482125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f7f4b0149b4ceeb84e4958266f1901', 'request_id': 'req-93c78ddd-77ce-403e-b9fc-d3a5643913d9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:04.530420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:04.563289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] The token cache is being invalidate because project c3f7f4b0149b4ceeb84e4958266f1901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:04.566104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:04.566104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-93c78ddd-77ce-403e-b9fc-d3a5643913d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:04.566104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1138/2284] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:04 2022] DELETE /identity/v3/projects/c3f7f4b0149b4ceeb84e4958266f1901 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:04.570938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eadf3-0783-4be1-84de-d081ca91a8e8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:04.571284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eadf3-0783-4be1-84de-d081ca91a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:04.571570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eadf3-0783-4be1-84de-d081ca91a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:04.598979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-436eadf3-0783-4be1-84de-d081ca91a8e8 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:04.600240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-436eadf3-0783-4be1-84de-d081ca91a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:04.674815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1147/2285] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:04.682484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cb59-9670-4d1a-b6c0-ed012ea0b21f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:04.682774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cb59-9670-4d1a-b6c0-ed012ea0b21f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:04.683186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cb59-9670-4d1a-b6c0-ed012ea0b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:04.704691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9727cb59-9670-4d1a-b6c0-ed012ea0b21f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:04.705930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9727cb59-9670-4d1a-b6c0-ed012ea0b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:04.718882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1139/2286] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:04.720688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436eadf3-0783-4be1-84de-d081ca91a8e8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:04.740111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436eadf3-0783-4be1-84de-d081ca91a8e8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:04.742799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:04.744211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:04.744211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:04.744436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:04.745281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:42:04.745586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:04.747186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:04.760975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1148/2287] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:42:04.765995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727cb59-9670-4d1a-b6c0-ed012ea0b21f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:04.795397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727cb59-9670-4d1a-b6c0-ed012ea0b21f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:04.803027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9a18c-1a53-439d-b79a-f2acaef71e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:04.803715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a18c-1a53-439d-b79a-f2acaef71e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:04.804037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a18c-1a53-439d-b79a-f2acaef71e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:04.804316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a18c-1a53-439d-b79a-f2acaef71e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:04.805164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9a18c-1a53-439d-b79a-f2acaef71e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:04.807654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9a18c-1a53-439d-b79a-f2acaef71e76 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:04.949106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1140/2288] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:04 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:04.953912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:04.964868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18934f-958f-4b82-9a0c-f529a0f39cf0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:05.064001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba422-3c65-49da-9ad3-734a40e8b74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:05.064753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba422-3c65-49da-9ad3-734a40e8b74f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:05.065218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba422-3c65-49da-9ad3-734a40e8b74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:05.065516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba422-3c65-49da-9ad3-734a40e8b74f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:05.066295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ba422-3c65-49da-9ad3-734a40e8b74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:05.068359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ba422-3c65-49da-9ad3-734a40e8b74f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:05.163634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1149/2289] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:04 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:05.164331 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9a18c-1a53-439d-b79a-f2acaef71e76 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:05.175165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9a18c-1a53-439d-b79a-f2acaef71e76 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:05.181652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715785e-2d3f-4c04-8d50-0ee7f24be7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:05.186296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715785e-2d3f-4c04-8d50-0ee7f24be7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:05.186296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715785e-2d3f-4c04-8d50-0ee7f24be7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:05.186296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715785e-2d3f-4c04-8d50-0ee7f24be7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:05.186296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715785e-2d3f-4c04-8d50-0ee7f24be7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:05.186296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715785e-2d3f-4c04-8d50-0ee7f24be7bd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:05.202778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba422-3c65-49da-9ad3-734a40e8b74f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:05.203371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1141/2290] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:05.215724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba422-3c65-49da-9ad3-734a40e8b74f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:05.220805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56485125-eff4-47a1-9264-b272ce572e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:05.222003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56485125-eff4-47a1-9264-b272ce572e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:05.229020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56485125-eff4-47a1-9264-b272ce572e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:05.229020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56485125-eff4-47a1-9264-b272ce572e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:05.229020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56485125-eff4-47a1-9264-b272ce572e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:05.229020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56485125-eff4-47a1-9264-b272ce572e73 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:05.232222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763640-f1c5-4681-92bc-eac2c8f07311 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:05.232542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763640-f1c5-4681-92bc-eac2c8f07311 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:05.232815 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763640-f1c5-4681-92bc-eac2c8f07311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:05.236203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1150/2291] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:05.240314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56485125-eff4-47a1-9264-b272ce572e73 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:05.251192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56485125-eff4-47a1-9264-b272ce572e73 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:05.256679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5e501-ba57-46ca-bdcd-e79e6fe66717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:05.257558 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5e501-ba57-46ca-bdcd-e79e6fe66717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:05.257860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5e501-ba57-46ca-bdcd-e79e6fe66717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:05.258117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5e501-ba57-46ca-bdcd-e79e6fe66717 admin admin] PATH_INFO: `/v3/projects/da43fb5efa7449568376d452bda0b9b5/users/f776741beb5642428f3ad31ea5090ccb/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:05.261545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2d763640-f1c5-4681-92bc-eac2c8f07311 None None] MFA Rules not processed for user `69b1e491e65c4c0791623039f3ae4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:05.262758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2d763640-f1c5-4681-92bc-eac2c8f07311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:05.274676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5e501-ba57-46ca-bdcd-e79e6fe66717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da43fb5efa7449568376d452bda0b9b5, user_id=f776741beb5642428f3ad31ea5090ccb, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:05.277501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5e501-ba57-46ca-bdcd-e79e6fe66717 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:05.284228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:05.338310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1142/2292] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:05.353093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763640-f1c5-4681-92bc-eac2c8f07311 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:05.354536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2d763640-f1c5-4681-92bc-eac2c8f07311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:05.357335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1151/2293] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:05 2022] PUT /identity/v3/projects/da43fb5efa7449568376d452bda0b9b5/users/f776741beb5642428f3ad31ea5090ccb/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:05.367862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c04d-a043-4733-915c-da4f3eaae557 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:05.379665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c04d-a043-4733-915c-da4f3eaae557 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:05.379665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4c04d-a043-4733-915c-da4f3eaae557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:05.396200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cef4c04d-a043-4733-915c-da4f3eaae557 None None] MFA Rules not processed for user `f776741beb5642428f3ad31ea5090ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:05.397919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cef4c04d-a043-4733-915c-da4f3eaae557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:05.429635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763640-f1c5-4681-92bc-eac2c8f07311 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:05.464511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1152/2294] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:05.475983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4c04d-a043-4733-915c-da4f3eaae557 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:05.477328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cef4c04d-a043-4733-915c-da4f3eaae557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:05.494445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:05.495092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:05.495373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:05.495649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:05.497421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:05.536378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4c04d-a043-4733-915c-da4f3eaae557 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:05.540022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb582-e114-4925-8ac6-12997a840cf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d6317775c343eaa9397254074647f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:05.540708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb582-e114-4925-8ac6-12997a840cf2 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:05.541219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb582-e114-4925-8ac6-12997a840cf2 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:05.541346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb582-e114-4925-8ac6-12997a840cf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:05.550468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdb582-e114-4925-8ac6-12997a840cf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:05.552333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdb582-e114-4925-8ac6-12997a840cf2 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:05.559136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:05.561335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:05.563796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1153/2295] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:05.571206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1143/2296] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:05.628026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:05.843132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:06.905531 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:07.066968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:07.690022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:08.404051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb438-14a3-4056-b38b-1191f7322e91 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:08.404657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb438-14a3-4056-b38b-1191f7322e91 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:08.404657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb438-14a3-4056-b38b-1191f7322e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:08.424760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-9cebb438-14a3-4056-b38b-1191f7322e91 None None] MFA Rules not processed for user `7488c1659ed64e9bb4c28a7284578d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:08.425893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9cebb438-14a3-4056-b38b-1191f7322e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:08.433122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1154/2297] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:08.605080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:11.354251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:11.355738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:11.423226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a6b4a-afc1-4df8-8f4b-64ed2a0a29ce service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:11.427789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:11.428670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:11.428950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:11.429221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] PATH_INFO: `/v3/users/4fd39e09278b40af8775b6e538769c5a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:11.430446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd39e09278b40af8775b6e538769c5a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:11.432389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:11.442933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:11.649927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd39e09278b40af8775b6e538769c5a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:11.750221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd39e09278b40af8775b6e538769c5a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:11.762762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd39e09278b40af8775b6e538769c5a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:11.763401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd39e09278b40af8775b6e538769c5a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:11.770250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd39e09278b40af8775b6e538769c5a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:11.776255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1144/2298] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:11 2022] DELETE /identity/v3/users/4fd39e09278b40af8775b6e538769c5a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:11.781306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeab7e-c9a3-4feb-9f1b-969e2ab6e237 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:11.785635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeab7e-c9a3-4feb-9f1b-969e2ab6e237 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:11.785635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeab7e-c9a3-4feb-9f1b-969e2ab6e237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:11.799344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c9eeab7e-c9a3-4feb-9f1b-969e2ab6e237 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:11.800505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9eeab7e-c9a3-4feb-9f1b-969e2ab6e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:11.828956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:11.859847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1155/2299] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:11.869678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:11.876739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:11.934859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bea8-2263-4bfc-bd41-7b2080b90bfd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:11.939675 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4653af5-89e4-4a34-8f79-98fa62d413be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:11.940410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653af5-89e4-4a34-8f79-98fa62d413be service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:11.940690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653af5-89e4-4a34-8f79-98fa62d413be service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:11.940987 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653af5-89e4-4a34-8f79-98fa62d413be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:11.950944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4653af5-89e4-4a34-8f79-98fa62d413be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:11.953017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4653af5-89e4-4a34-8f79-98fa62d413be service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:11.962635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1145/2300] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:12.415568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeab7e-c9a3-4feb-9f1b-969e2ab6e237 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:12.415568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c9eeab7e-c9a3-4feb-9f1b-969e2ab6e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:12.451463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeab7e-c9a3-4feb-9f1b-969e2ab6e237 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:12.460143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:12.461517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:12.461723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:12.462890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] PATH_INFO: `/v3/projects/f81b19c9a7c644f18f53c8b5f52900d2` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:12.464345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81b19c9a7c644f18f53c8b5f52900d2)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:12.467439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:12.622466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81b19c9a7c644f18f53c8b5f52900d2', 'request_id': 'req-21abb938-7cea-49a1-b000-5eb7d44e9f6f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:12.628498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81b19c9a7c644f18f53c8b5f52900d2', 'request_id': 'req-21abb938-7cea-49a1-b000-5eb7d44e9f6f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:12.634774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81b19c9a7c644f18f53c8b5f52900d2', 'request_id': 'req-21abb938-7cea-49a1-b000-5eb7d44e9f6f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:12.749524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] The token cache is being invalidate because project f81b19c9a7c644f18f53c8b5f52900d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:12.749524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:12.749524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:12.750585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1156/2301] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:12 2022] DELETE /identity/v3/projects/f81b19c9a7c644f18f53c8b5f52900d2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:12.755043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4653af5-89e4-4a34-8f79-98fa62d413be service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:12.765150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4653af5-89e4-4a34-8f79-98fa62d413be service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:12.828368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:12.829367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:12.829648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:12.829923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] PATH_INFO: `/v3/users/aa1c5656781f4358b1999bfd7d5a2c95` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:12.831116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1c5656781f4358b1999bfd7d5a2c95)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:12.833084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:13.022483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:13.035046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1c5656781f4358b1999bfd7d5a2c95'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.129412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1c5656781f4358b1999bfd7d5a2c95'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.141852 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1c5656781f4358b1999bfd7d5a2c95'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.142479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1c5656781f4358b1999bfd7d5a2c95'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.149100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d752756b-6000-4560-8c22-b65929eccfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1c5656781f4358b1999bfd7d5a2c95'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.155368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1146/2302] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:12 2022] DELETE /identity/v3/users/aa1c5656781f4358b1999bfd7d5a2c95 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:13.591895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:13.595203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:13.613109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abb938-7cea-49a1-b000-5eb7d44e9f6f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:13.682206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:13.682206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:13.682439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:13.682580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] PATH_INFO: `/v3/projects/277750a6fb3a4e089c0ce0ded2416d54` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:13.683769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277750a6fb3a4e089c0ce0ded2416d54)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:13.685716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:13.826148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277750a6fb3a4e089c0ce0ded2416d54', 'request_id': 'req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.834412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277750a6fb3a4e089c0ce0ded2416d54', 'request_id': 'req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.835803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:13.843171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277750a6fb3a4e089c0ce0ded2416d54', 'request_id': 'req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.963355 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] The token cache is being invalidate because project 277750a6fb3a4e089c0ce0ded2416d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:13.963765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.966844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-50316cfd-7e2d-43d9-b763-96c75bf5e9f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:13.966844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1157/2303] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:13 2022] DELETE /identity/v3/projects/277750a6fb3a4e089c0ce0ded2416d54 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:13.971271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b182-0db0-4ff8-b227-2daa71ed10dc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:13.971741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b182-0db0-4ff8-b227-2daa71ed10dc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:13.971830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b182-0db0-4ff8-b227-2daa71ed10dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:13.990491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1197b182-0db0-4ff8-b227-2daa71ed10dc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:13.991693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1197b182-0db0-4ff8-b227-2daa71ed10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:14.054227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1147/2304] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:14.063413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818b5f-354a-496c-81be-852f7bfc9040 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.063640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818b5f-354a-496c-81be-852f7bfc9040 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.063928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818b5f-354a-496c-81be-852f7bfc9040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.085453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b4818b5f-354a-496c-81be-852f7bfc9040 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:14.086731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b4818b5f-354a-496c-81be-852f7bfc9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:14.095815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1158/2305] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:14.100616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b182-0db0-4ff8-b227-2daa71ed10dc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.111430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b182-0db0-4ff8-b227-2daa71ed10dc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.116281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.116941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.117225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.117502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.118224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:42:14.118532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.120168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.132728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1148/2306] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:42:14.137118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4818b5f-354a-496c-81be-852f7bfc9040 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.147008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4818b5f-354a-496c-81be-852f7bfc9040 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.151867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.152550 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.152833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.153109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.153822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.155753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.224600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1159/2307] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:14 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:14.228865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.239754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530933b-e255-4bbc-a05f-85a2306b297d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.240466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.242116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:14.300632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5034-bb9f-48f0-8f70-9aaea0d03d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.301358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5034-bb9f-48f0-8f70-9aaea0d03d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.301645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5034-bb9f-48f0-8f70-9aaea0d03d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.301930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f5034-bb9f-48f0-8f70-9aaea0d03d0c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.302666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5034-bb9f-48f0-8f70-9aaea0d03d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.304718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f5034-bb9f-48f0-8f70-9aaea0d03d0c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.317486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215a8eb-2a61-4166-9ce5-94a53b323d28 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.322457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.323328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.323610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.323886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] PATH_INFO: `/v3/users/ef7a3117cff54ec6b07027530e9c2d5a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.325119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7a3117cff54ec6b07027530e9c2d5a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.327063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.375462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1149/2308] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:14 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:42:14.379188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5034-bb9f-48f0-8f70-9aaea0d03d0c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.388768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f5034-bb9f-48f0-8f70-9aaea0d03d0c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.393432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dd12c-a314-4d38-9cb3-01eeda15ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.394052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dd12c-a314-4d38-9cb3-01eeda15ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.394338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dd12c-a314-4d38-9cb3-01eeda15ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.394616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dd12c-a314-4d38-9cb3-01eeda15ab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.395325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dd12c-a314-4d38-9cb3-01eeda15ab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.396975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dd12c-a314-4d38-9cb3-01eeda15ab7f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.407300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1150/2309] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:42:14.416727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dd12c-a314-4d38-9cb3-01eeda15ab7f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.426583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dd12c-a314-4d38-9cb3-01eeda15ab7f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.435447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fbc6a-1599-4a63-b1af-be6c8585ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.436822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fbc6a-1599-4a63-b1af-be6c8585ed96 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.437111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fbc6a-1599-4a63-b1af-be6c8585ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.437388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fbc6a-1599-4a63-b1af-be6c8585ed96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.438125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fbc6a-1599-4a63-b1af-be6c8585ed96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.439783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fbc6a-1599-4a63-b1af-be6c8585ed96 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.455663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1151/2310] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:42:14.463129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fbc6a-1599-4a63-b1af-be6c8585ed96 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.469535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:14.473378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fbc6a-1599-4a63-b1af-be6c8585ed96 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.478190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ebd86-47da-4a10-b695-17b5bd971758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.479124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ebd86-47da-4a10-b695-17b5bd971758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.479418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ebd86-47da-4a10-b695-17b5bd971758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.479695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ebd86-47da-4a10-b695-17b5bd971758 admin admin] PATH_INFO: `/v3/projects/6ee9f1d993ff4a0e9272067c2f12e61a/users/83e5800092924180940ecdf27627c3cd/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.494721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ebd86-47da-4a10-b695-17b5bd971758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee9f1d993ff4a0e9272067c2f12e61a, user_id=83e5800092924180940ecdf27627c3cd, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.497477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ebd86-47da-4a10-b695-17b5bd971758 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.519753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7a3117cff54ec6b07027530e9c2d5a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:14.526465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7a3117cff54ec6b07027530e9c2d5a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:14.592487 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1152/2311] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:14 2022] PUT /identity/v3/projects/6ee9f1d993ff4a0e9272067c2f12e61a/users/83e5800092924180940ecdf27627c3cd/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:14.602762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd369518-86ad-4e7f-b4bc-6bb476599f5a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.603023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd369518-86ad-4e7f-b4bc-6bb476599f5a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.607169 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd369518-86ad-4e7f-b4bc-6bb476599f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.625358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7a3117cff54ec6b07027530e9c2d5a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:14.626059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7a3117cff54ec6b07027530e9c2d5a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:14.634452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cd369518-86ad-4e7f-b4bc-6bb476599f5a None None] MFA Rules not processed for user `83e5800092924180940ecdf27627c3cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:14.636203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cd369518-86ad-4e7f-b4bc-6bb476599f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:14.640011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2783daa4-8664-4f60-8f3b-c2aa5fb29fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7a3117cff54ec6b07027530e9c2d5a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:14.646215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1160/2312] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:14 2022] DELETE /identity/v3/users/ef7a3117cff54ec6b07027530e9c2d5a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:14.650445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93811-0785-45ca-9cc9-fe8bc623bf91 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.650737 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93811-0785-45ca-9cc9-fe8bc623bf91 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.652057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93811-0785-45ca-9cc9-fe8bc623bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.668758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3cc93811-0785-45ca-9cc9-fe8bc623bf91 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:14.670008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3cc93811-0785-45ca-9cc9-fe8bc623bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:14.707558 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:14.710363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1153/2313] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:14.710673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd369518-86ad-4e7f-b4bc-6bb476599f5a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.712121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cd369518-86ad-4e7f-b4bc-6bb476599f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:14.746445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1161/2314] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:14.757143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc93811-0785-45ca-9cc9-fe8bc623bf91 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.759007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3cc93811-0785-45ca-9cc9-fe8bc623bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:14.798406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd369518-86ad-4e7f-b4bc-6bb476599f5a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.803789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2028e38-81ac-4b68-bd52-d7a69a667c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.804551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028e38-81ac-4b68-bd52-d7a69a667c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.804912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028e38-81ac-4b68-bd52-d7a69a667c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.805262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028e38-81ac-4b68-bd52-d7a69a667c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.806422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2028e38-81ac-4b68-bd52-d7a69a667c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.810071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2028e38-81ac-4b68-bd52-d7a69a667c48 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.831434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc93811-0785-45ca-9cc9-fe8bc623bf91 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.835273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f55c-78e2-49f7-81d0-e9f69024324d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.836102 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f55c-78e2-49f7-81d0-e9f69024324d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.836453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f55c-78e2-49f7-81d0-e9f69024324d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.836738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f55c-78e2-49f7-81d0-e9f69024324d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.847116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618f55c-78e2-49f7-81d0-e9f69024324d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.848576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618f55c-78e2-49f7-81d0-e9f69024324d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:14.859451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1162/2315] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:42:14.902228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1154/2316] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:14 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:14.906308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f55c-78e2-49f7-81d0-e9f69024324d service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:14.917056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f55c-78e2-49f7-81d0-e9f69024324d service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:14.976227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2103e-c717-4a54-a5b6-d982424e00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:14.976987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2103e-c717-4a54-a5b6-d982424e00cd admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:14.977273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2103e-c717-4a54-a5b6-d982424e00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:14.977553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2103e-c717-4a54-a5b6-d982424e00cd admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:14.978444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2103e-c717-4a54-a5b6-d982424e00cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:14.980587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2103e-c717-4a54-a5b6-d982424e00cd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:15.058839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1163/2317] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:14 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:15.060041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2028e38-81ac-4b68-bd52-d7a69a667c48 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:15.071677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2028e38-81ac-4b68-bd52-d7a69a667c48 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:15.079296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337df47-4dcf-44eb-b51f-1dd81d8854ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:15.079993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337df47-4dcf-44eb-b51f-1dd81d8854ec admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:15.080279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337df47-4dcf-44eb-b51f-1dd81d8854ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:15.080605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337df47-4dcf-44eb-b51f-1dd81d8854ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:15.081440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337df47-4dcf-44eb-b51f-1dd81d8854ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:15.083060 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337df47-4dcf-44eb-b51f-1dd81d8854ec admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:15.095436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1155/2318] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:15.099689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2103e-c717-4a54-a5b6-d982424e00cd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:15.110198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2103e-c717-4a54-a5b6-d982424e00cd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:15.114874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:15.115778 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:15.119780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:15.119780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] PATH_INFO: `/v3/projects/f26833dd94c643c2877d1e09263a5883/users/38812aec0aa4402aa92e54e1eec010eb/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:15.131958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26833dd94c643c2877d1e09263a5883, user_id=38812aec0aa4402aa92e54e1eec010eb, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:15.134708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:15.213872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1164/2319] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:15 2022] PUT /identity/v3/projects/f26833dd94c643c2877d1e09263a5883/users/38812aec0aa4402aa92e54e1eec010eb/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:15.217920 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337df47-4dcf-44eb-b51f-1dd81d8854ec admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:15.229311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337df47-4dcf-44eb-b51f-1dd81d8854ec admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:15.272204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:15.276104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:15.278271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:15.289803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02401-9a30-4c45-91a4-1e3861fb3ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:15.290529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02401-9a30-4c45-91a4-1e3861fb3ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:15.290753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02401-9a30-4c45-91a4-1e3861fb3ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:15.291030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02401-9a30-4c45-91a4-1e3861fb3ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:15.291878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b02401-9a30-4c45-91a4-1e3861fb3ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:15.293502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b02401-9a30-4c45-91a4-1e3861fb3ba8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:15.305275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1156/2320] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:15.309500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02401-9a30-4c45-91a4-1e3861fb3ba8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:15.324168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02401-9a30-4c45-91a4-1e3861fb3ba8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:15.329135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245fc37-6234-4ca6-b9a7-99a0f54b1f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:15.330026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245fc37-6234-4ca6-b9a7-99a0f54b1f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:15.330313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245fc37-6234-4ca6-b9a7-99a0f54b1f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:15.330598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245fc37-6234-4ca6-b9a7-99a0f54b1f3e admin admin] PATH_INFO: `/v3/projects/f26833dd94c643c2877d1e09263a5883/users/38812aec0aa4402aa92e54e1eec010eb/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:15.332617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245fc37-6234-4ca6-b9a7-99a0f54b1f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26833dd94c643c2877d1e09263a5883, user_id=38812aec0aa4402aa92e54e1eec010eb, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:15.335274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245fc37-6234-4ca6-b9a7-99a0f54b1f3e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:15.336183 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:15.346298 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1157/2321] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:15 2022] PUT /identity/v3/projects/f26833dd94c643c2877d1e09263a5883/users/38812aec0aa4402aa92e54e1eec010eb/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:15.355153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dc21d-53f6-4248-bb55-c7d68cd55384 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:15.356834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aad97-a470-4f97-a898-0449e8e70fe9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:15.357234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aad97-a470-4f97-a898-0449e8e70fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:15.357691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aad97-a470-4f97-a898-0449e8e70fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:15.385702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c89aad97-a470-4f97-a898-0449e8e70fe9 None None] MFA Rules not processed for user `38812aec0aa4402aa92e54e1eec010eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:15.387179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c89aad97-a470-4f97-a898-0449e8e70fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:15.416113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:15.417139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:15.417256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:15.417513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] PATH_INFO: `/v3/projects/ac1a22a7b7a14121bebe3354d4605922` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:15.418701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1a22a7b7a14121bebe3354d4605922)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:15.421237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:15.458575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1158/2322] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:15.470531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aad97-a470-4f97-a898-0449e8e70fe9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:15.471882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c89aad97-a470-4f97-a898-0449e8e70fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:15.538476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aad97-a470-4f97-a898-0449e8e70fe9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:15.549025 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1a22a7b7a14121bebe3354d4605922', 'request_id': 'req-fe2a1c07-515f-4945-a695-5e88323aec15'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:15.561044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1a22a7b7a14121bebe3354d4605922', 'request_id': 'req-fe2a1c07-515f-4945-a695-5e88323aec15'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:15.568187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1a22a7b7a14121bebe3354d4605922', 'request_id': 'req-fe2a1c07-515f-4945-a695-5e88323aec15'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:15.590195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d24aa-8cda-4716-8082-2e112d2fd912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:15.590837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d24aa-8cda-4716-8082-2e112d2fd912 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:15.591119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d24aa-8cda-4716-8082-2e112d2fd912 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:15.591392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d24aa-8cda-4716-8082-2e112d2fd912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:15.616232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:15.637193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] The token cache is being invalidate because project ac1a22a7b7a14121bebe3354d4605922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:15.637703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:15.638483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:15.640502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1165/2323] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:15 2022] DELETE /identity/v3/projects/ac1a22a7b7a14121bebe3354d4605922 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:15.660218 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d24aa-8cda-4716-8082-2e112d2fd912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:15.661890 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d24aa-8cda-4716-8082-2e112d2fd912 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:15.674883 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1159/2324] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:42:15.924488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:15.925977 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:15.938026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a1c07-515f-4945-a695-5e88323aec15 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:15.941559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bd790-aba2-444f-99e8-a440ee746ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:15.942195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bd790-aba2-444f-99e8-a440ee746ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:15.942474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bd790-aba2-444f-99e8-a440ee746ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:15.942751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bd790-aba2-444f-99e8-a440ee746ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:15.944497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6b4bd790-aba2-444f-99e8-a440ee746ba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:16.008695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bd790-aba2-444f-99e8-a440ee746ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:16.010248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bd790-aba2-444f-99e8-a440ee746ba7 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:16.023504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1166/2325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:23.687494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d24aa-8cda-4716-8082-2e112d2fd912 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:23.759997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d24aa-8cda-4716-8082-2e112d2fd912 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:23.764884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:23.765777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:23.766063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:23.766342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] PATH_INFO: `/v3/users/83e5800092924180940ecdf27627c3cd` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:23.767550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e5800092924180940ecdf27627c3cd)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:23.769495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:23.928387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e5800092924180940ecdf27627c3cd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:23.991756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e5800092924180940ecdf27627c3cd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.008251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e5800092924180940ecdf27627c3cd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.009028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e5800092924180940ecdf27627c3cd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.017650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e5800092924180940ecdf27627c3cd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.023785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1160/2326] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:23 2022] DELETE /identity/v3/users/83e5800092924180940ecdf27627c3cd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:24.028707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915941-f14d-48d3-b7ae-4ab01fe8374b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:24.034347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915941-f14d-48d3-b7ae-4ab01fe8374b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:24.034347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94915941-f14d-48d3-b7ae-4ab01fe8374b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:24.047886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-94915941-f14d-48d3-b7ae-4ab01fe8374b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:24.049116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94915941-f14d-48d3-b7ae-4ab01fe8374b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:24.070122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:24.124516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1167/2327] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:24.135599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:24.137396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:24.154844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94915941-f14d-48d3-b7ae-4ab01fe8374b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:24.157041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94915941-f14d-48d3-b7ae-4ab01fe8374b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:24.170241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94915941-f14d-48d3-b7ae-4ab01fe8374b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:24.175270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:24.176165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:24.176446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:24.176721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] PATH_INFO: `/v3/users/52a0bc7bca214a6cbab78e5a1d122be2` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:24.178279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a0bc7bca214a6cbab78e5a1d122be2)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:24.180113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:24.188577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:24.209727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958a357-ddc1-4e87-b63a-4279cb7b2f56 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:24.213665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bc59a-8030-4955-8385-03ae6fa2e0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:24.214318 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bc59a-8030-4955-8385-03ae6fa2e0da service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:24.214629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bc59a-8030-4955-8385-03ae6fa2e0da service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:24.214910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bc59a-8030-4955-8385-03ae6fa2e0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:24.225930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bc59a-8030-4955-8385-03ae6fa2e0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:24.227371 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bc59a-8030-4955-8385-03ae6fa2e0da service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:24.237701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1161/2328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:24.370686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a0bc7bca214a6cbab78e5a1d122be2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.377933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a0bc7bca214a6cbab78e5a1d122be2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.466103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a0bc7bca214a6cbab78e5a1d122be2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.466748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a0bc7bca214a6cbab78e5a1d122be2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.479860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a0bc7bca214a6cbab78e5a1d122be2'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.487990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1168/2329] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:24 2022] DELETE /identity/v3/users/52a0bc7bca214a6cbab78e5a1d122be2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:24.499138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16cbe-fa96-4055-80f8-eb1fbacef2b1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:24.499138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16cbe-fa96-4055-80f8-eb1fbacef2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:24.499138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16cbe-fa96-4055-80f8-eb1fbacef2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:24.512615 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-16d16cbe-fa96-4055-80f8-eb1fbacef2b1 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:24.513821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-16d16cbe-fa96-4055-80f8-eb1fbacef2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:24.641444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1162/2330] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:24.650927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:24.652329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:24.697840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16cbe-fa96-4055-80f8-eb1fbacef2b1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:24.699357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-16d16cbe-fa96-4055-80f8-eb1fbacef2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:24.713267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e05d-c5fc-4ecc-a653-24c2a1bec641 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:24.714384 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16cbe-fa96-4055-80f8-eb1fbacef2b1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:24.717446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84a00-1ef4-44c0-9746-1c2b20acf9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:24.718344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84a00-1ef4-44c0-9746-1c2b20acf9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:24.718757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84a00-1ef4-44c0-9746-1c2b20acf9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:24.719168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84a00-1ef4-44c0-9746-1c2b20acf9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:24.720885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:24.721784 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:24.722064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:24.722340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] PATH_INFO: `/v3/projects/6ee9f1d993ff4a0e9272067c2f12e61a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:24.723566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee9f1d993ff4a0e9272067c2f12e61a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:24.726057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:24.730566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84a00-1ef4-44c0-9746-1c2b20acf9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:24.734848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84a00-1ef4-44c0-9746-1c2b20acf9dc service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:24.746554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1169/2331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:24.845710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee9f1d993ff4a0e9272067c2f12e61a', 'request_id': 'req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.852135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee9f1d993ff4a0e9272067c2f12e61a', 'request_id': 'req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.858679 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee9f1d993ff4a0e9272067c2f12e61a', 'request_id': 'req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.926782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] The token cache is being invalidate because project 6ee9f1d993ff4a0e9272067c2f12e61a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:24.927149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.927811 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:24.930183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1163/2332] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:24 2022] DELETE /identity/v3/projects/6ee9f1d993ff4a0e9272067c2f12e61a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:24.949569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84a00-1ef4-44c0-9746-1c2b20acf9dc service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:24.959425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84a00-1ef4-44c0-9746-1c2b20acf9dc service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:24.993458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:25.018138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:25.019086 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:25.019446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:25.019779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] PATH_INFO: `/v3/users/38812aec0aa4402aa92e54e1eec010eb` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:25.021119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38812aec0aa4402aa92e54e1eec010eb)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:25.023181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:25.186132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:25.187625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:25.206875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57ee86-1ef4-436d-b9c9-0c48a574bcd3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:25.213400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:25.216788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:25.216788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:25.216788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] PATH_INFO: `/v3/projects/4f59e93c39574a5ead24df091d959eae` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:25.216788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f59e93c39574a5ead24df091d959eae)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:25.218814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:25.227776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38812aec0aa4402aa92e54e1eec010eb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.237145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38812aec0aa4402aa92e54e1eec010eb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.344869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38812aec0aa4402aa92e54e1eec010eb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.345646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38812aec0aa4402aa92e54e1eec010eb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.364014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-59e7ce2c-fdd0-4654-a259-d9e11b57cc77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38812aec0aa4402aa92e54e1eec010eb'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.364204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f59e93c39574a5ead24df091d959eae', 'request_id': 'req-3435c859-095d-4d7d-bbc7-85632e0c070a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.370339 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f59e93c39574a5ead24df091d959eae', 'request_id': 'req-3435c859-095d-4d7d-bbc7-85632e0c070a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.371788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:25.372316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1170/2333] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:24 2022] DELETE /identity/v3/users/38812aec0aa4402aa92e54e1eec010eb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:25.377647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f59e93c39574a5ead24df091d959eae', 'request_id': 'req-3435c859-095d-4d7d-bbc7-85632e0c070a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.472284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] The token cache is being invalidate because project 4f59e93c39574a5ead24df091d959eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:25.472284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.472284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3435c859-095d-4d7d-bbc7-85632e0c070a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:25.472284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1164/2334] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:25 2022] DELETE /identity/v3/projects/4f59e93c39574a5ead24df091d959eae => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:25.476148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6564f4-368f-43ed-a52b-59b745c75db0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:25.476441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6564f4-368f-43ed-a52b-59b745c75db0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:25.476724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6564f4-368f-43ed-a52b-59b745c75db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:25.494281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7a6564f4-368f-43ed-a52b-59b745c75db0 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:25.495565 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7a6564f4-368f-43ed-a52b-59b745c75db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:25.565137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1171/2335] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:25.573769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2ec1-6a09-44da-b625-3f3d820c895f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:25.574305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2ec1-6a09-44da-b625-3f3d820c895f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:25.574772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2ec1-6a09-44da-b625-3f3d820c895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:25.609807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ed8d2ec1-6a09-44da-b625-3f3d820c895f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:25.611061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ed8d2ec1-6a09-44da-b625-3f3d820c895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:25.619578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1165/2336] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:25.623994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6564f4-368f-43ed-a52b-59b745c75db0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:25.633646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6564f4-368f-43ed-a52b-59b745c75db0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:25.639573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:25.640915 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:25.641105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:25.641644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:25.642411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:42:25.642721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:25.644525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:25.661056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1172/2337] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:42:25.662483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d2ec1-6a09-44da-b625-3f3d820c895f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:25.671792 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d2ec1-6a09-44da-b625-3f3d820c895f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:25.676702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:25.677355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:25.677644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:25.677921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:25.678655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:25.680604 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:25.804818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1166/2338] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:25.808957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:25.819168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacedfa7-c811-4a96-af75-5a79d1398b87 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:25.833525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:25.835757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:25.868585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:25.884765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a037349-7221-451b-8895-b9bbbcf223cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:25.885727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037349-7221-451b-8895-b9bbbcf223cc admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:25.886017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037349-7221-451b-8895-b9bbbcf223cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:25.886297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a037349-7221-451b-8895-b9bbbcf223cc admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:25.887125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a037349-7221-451b-8895-b9bbbcf223cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:25.889522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a037349-7221-451b-8895-b9bbbcf223cc admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:25.912932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67db66-9f5e-40c4-b1bf-04f48b1a2229 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:25.917518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:25.918369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:25.918647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:25.918919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] PATH_INFO: `/v3/projects/f26833dd94c643c2877d1e09263a5883` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:25.920131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26833dd94c643c2877d1e09263a5883)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:25.922076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.009270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1173/2339] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:25 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:26.013235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a037349-7221-451b-8895-b9bbbcf223cc admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.024180 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a037349-7221-451b-8895-b9bbbcf223cc admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.029714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bb105-f5b9-4493-9f22-427afaa493ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.030452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb105-f5b9-4493-9f22-427afaa493ad admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.030801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb105-f5b9-4493-9f22-427afaa493ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.031247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bb105-f5b9-4493-9f22-427afaa493ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.032567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bb105-f5b9-4493-9f22-427afaa493ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.036539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bb105-f5b9-4493-9f22-427afaa493ad admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.047106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1174/2340] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:42:26.051038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bb105-f5b9-4493-9f22-427afaa493ad admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.054758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26833dd94c643c2877d1e09263a5883', 'request_id': 'req-7e08e5d2-e2b6-4086-b56b-5433db358e01'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:26.062903 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bb105-f5b9-4493-9f22-427afaa493ad admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.076562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26833dd94c643c2877d1e09263a5883', 'request_id': 'req-7e08e5d2-e2b6-4086-b56b-5433db358e01'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:26.086287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26833dd94c643c2877d1e09263a5883', 'request_id': 'req-7e08e5d2-e2b6-4086-b56b-5433db358e01'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:26.129431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052be2dd-1853-420c-9932-9e4375592220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.130101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052be2dd-1853-420c-9932-9e4375592220 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.130385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052be2dd-1853-420c-9932-9e4375592220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.130664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052be2dd-1853-420c-9932-9e4375592220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.131412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052be2dd-1853-420c-9932-9e4375592220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.133049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052be2dd-1853-420c-9932-9e4375592220 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.143672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1175/2341] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:26.148100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052be2dd-1853-420c-9932-9e4375592220 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.157838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052be2dd-1853-420c-9932-9e4375592220 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.162663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbabf8-cca1-4e14-9e8b-2c47d03c11b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.163526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbabf8-cca1-4e14-9e8b-2c47d03c11b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.163804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbabf8-cca1-4e14-9e8b-2c47d03c11b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.164118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbabf8-cca1-4e14-9e8b-2c47d03c11b3 admin admin] PATH_INFO: `/v3/projects/a0645668bf03499f97a2a54cbe75e3fe/users/b7de51e3989248088b608a5d50400064/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.180316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] The token cache is being invalidate because project f26833dd94c643c2877d1e09263a5883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:26.180628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:26.182860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7e08e5d2-e2b6-4086-b56b-5433db358e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:26.182973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1167/2342] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:25 2022] DELETE /identity/v3/projects/f26833dd94c643c2877d1e09263a5883 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:26.188509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5eea1-6c3f-4dc7-bd14-17e1728055af None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.188643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbabf8-cca1-4e14-9e8b-2c47d03c11b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0645668bf03499f97a2a54cbe75e3fe, user_id=b7de51e3989248088b608a5d50400064, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.188808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5eea1-6c3f-4dc7-bd14-17e1728055af None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.189073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5eea1-6c3f-4dc7-bd14-17e1728055af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.191645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbabf8-cca1-4e14-9e8b-2c47d03c11b3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.209503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c1f5eea1-6c3f-4dc7-bd14-17e1728055af None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:26.210683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c1f5eea1-6c3f-4dc7-bd14-17e1728055af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:26.218913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1168/2343] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:26.227551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8b74-d3bd-462a-aaa1-b2d483f84a49 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.227833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8b74-d3bd-462a-aaa1-b2d483f84a49 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.228133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8b74-d3bd-462a-aaa1-b2d483f84a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.245820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e32d8b74-d3bd-462a-aaa1-b2d483f84a49 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:26.246982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e32d8b74-d3bd-462a-aaa1-b2d483f84a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:26.255540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1169/2344] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:26.259257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1176/2345] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:26 2022] PUT /identity/v3/projects/a0645668bf03499f97a2a54cbe75e3fe/users/b7de51e3989248088b608a5d50400064/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:26.259789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8b74-d3bd-462a-aaa1-b2d483f84a49 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.264294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee26f8-761a-4047-9c73-c65466ebce5b None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.264581 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee26f8-761a-4047-9c73-c65466ebce5b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.265080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee26f8-761a-4047-9c73-c65466ebce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.269032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8b74-d3bd-462a-aaa1-b2d483f84a49 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.281711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-33ee26f8-761a-4047-9c73-c65466ebce5b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:26.282884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-33ee26f8-761a-4047-9c73-c65466ebce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:26.305372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:26.331927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.332586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.332893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.333165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.334003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:42:26.334311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.336016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.345084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1177/2346] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:26.353463 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1170/2347] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:42:26.358195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.359645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee26f8-761a-4047-9c73-c65466ebce5b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.361559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:26.370463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee26f8-761a-4047-9c73-c65466ebce5b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.375710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132cf1b-dc18-4bdc-b643-6aa51b35b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.377811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132cf1b-dc18-4bdc-b643-6aa51b35b34c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.377811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132cf1b-dc18-4bdc-b643-6aa51b35b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.377811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132cf1b-dc18-4bdc-b643-6aa51b35b34c admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.377811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132cf1b-dc18-4bdc-b643-6aa51b35b34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.379577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132cf1b-dc18-4bdc-b643-6aa51b35b34c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.419830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ace2d-85e7-4254-9b7d-9313a1823092 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.424016 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464933e-7b14-4c55-b849-3c98fba66ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.424656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464933e-7b14-4c55-b849-3c98fba66ece service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.424935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464933e-7b14-4c55-b849-3c98fba66ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.425211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464933e-7b14-4c55-b849-3c98fba66ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.434587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464933e-7b14-4c55-b849-3c98fba66ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.436368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464933e-7b14-4c55-b849-3c98fba66ece service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.448574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1171/2348] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:26.460326 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1178/2349] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:26 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:42:26.461410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464933e-7b14-4c55-b849-3c98fba66ece service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.472283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464933e-7b14-4c55-b849-3c98fba66ece service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.531495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2354-44c0-4c65-85e4-e56dee747ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.532206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2354-44c0-4c65-85e4-e56dee747ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.532490 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2354-44c0-4c65-85e4-e56dee747ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.532769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e2354-44c0-4c65-85e4-e56dee747ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.533456 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e2354-44c0-4c65-85e4-e56dee747ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.535537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e2354-44c0-4c65-85e4-e56dee747ab9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.638652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1172/2350] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:26 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:42:26.642413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132cf1b-dc18-4bdc-b643-6aa51b35b34c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.666151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132cf1b-dc18-4bdc-b643-6aa51b35b34c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.672580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367b28c-0845-4027-8211-c05cf3fd468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.673240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b28c-0845-4027-8211-c05cf3fd468c admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.673587 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b28c-0845-4027-8211-c05cf3fd468c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.673932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b28c-0845-4027-8211-c05cf3fd468c admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.674925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367b28c-0845-4027-8211-c05cf3fd468c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.676688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367b28c-0845-4027-8211-c05cf3fd468c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.688046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1179/2351] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:26.692119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2354-44c0-4c65-85e4-e56dee747ab9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.703219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e2354-44c0-4c65-85e4-e56dee747ab9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.707808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5351a3-56cb-459d-9dad-fd4532390198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.708515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5351a3-56cb-459d-9dad-fd4532390198 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.708776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5351a3-56cb-459d-9dad-fd4532390198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.709045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5351a3-56cb-459d-9dad-fd4532390198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.709755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5351a3-56cb-459d-9dad-fd4532390198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.711337 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5351a3-56cb-459d-9dad-fd4532390198 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.721880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1173/2352] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:26.726574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367b28c-0845-4027-8211-c05cf3fd468c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:26.731833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:26.738133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367b28c-0845-4027-8211-c05cf3fd468c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:26.743273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b75486-cd93-4836-a13e-9f94f848976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:26.744191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75486-cd93-4836-a13e-9f94f848976d admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.744475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75486-cd93-4836-a13e-9f94f848976d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.744752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b75486-cd93-4836-a13e-9f94f848976d admin admin] PATH_INFO: `/v3/projects/cd3689a8b5084a4bb2c147ba950d90b6/users/40690e55b6bd451bb74cd64f0ec865f9/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.759879 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b75486-cd93-4836-a13e-9f94f848976d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3689a8b5084a4bb2c147ba950d90b6, user_id=40690e55b6bd451bb74cd64f0ec865f9, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:26.763298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b75486-cd93-4836-a13e-9f94f848976d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:26.842084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1180/2353] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:26 2022] PUT /identity/v3/projects/cd3689a8b5084a4bb2c147ba950d90b6/users/40690e55b6bd451bb74cd64f0ec865f9/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:26.853108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c0e31-1a13-41b3-b1b3-1a068f1926ac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:26.853626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c0e31-1a13-41b3-b1b3-1a068f1926ac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:26.853827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c0e31-1a13-41b3-b1b3-1a068f1926ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:26.883194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-933c0e31-1a13-41b3-b1b3-1a068f1926ac None None] MFA Rules not processed for user `40690e55b6bd451bb74cd64f0ec865f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:26.884477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-933c0e31-1a13-41b3-b1b3-1a068f1926ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:26.932425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:26.956484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1174/2354] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:26.961005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b75486-cd93-4836-a13e-9f94f848976d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:27.028997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b75486-cd93-4836-a13e-9f94f848976d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:27.034510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db1cc2-0f26-422e-abf4-714c617281f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:27.035172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1cc2-0f26-422e-abf4-714c617281f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.035522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1cc2-0f26-422e-abf4-714c617281f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.035784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1cc2-0f26-422e-abf4-714c617281f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.036512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db1cc2-0f26-422e-abf4-714c617281f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:27.038429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db1cc2-0f26-422e-abf4-714c617281f6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:27.176533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1181/2355] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:26 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:42:27.180561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c0e31-1a13-41b3-b1b3-1a068f1926ac None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:27.191500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c0e31-1a13-41b3-b1b3-1a068f1926ac None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:27.272603 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1789d-4c5b-4f07-863e-8fb43a480d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:27.273286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1789d-4c5b-4f07-863e-8fb43a480d50 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.273583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1789d-4c5b-4f07-863e-8fb43a480d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.273825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1789d-4c5b-4f07-863e-8fb43a480d50 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.274521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1789d-4c5b-4f07-863e-8fb43a480d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:27.276651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1789d-4c5b-4f07-863e-8fb43a480d50 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:27.394012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1175/2356] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:27 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:27.398069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db1cc2-0f26-422e-abf4-714c617281f6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:27.408272 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db1cc2-0f26-422e-abf4-714c617281f6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:27.413204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15391-f21e-45d7-81a9-bc812a74e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:27.414038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15391-f21e-45d7-81a9-bc812a74e1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.414394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15391-f21e-45d7-81a9-bc812a74e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.414671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15391-f21e-45d7-81a9-bc812a74e1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.415393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb15391-f21e-45d7-81a9-bc812a74e1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:27.417111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb15391-f21e-45d7-81a9-bc812a74e1f8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:27.429049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1182/2357] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:42:27.432947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1789d-4c5b-4f07-863e-8fb43a480d50 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:27.444621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1789d-4c5b-4f07-863e-8fb43a480d50 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:27.449518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140c267-1e27-468f-9cac-af9298b63c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:27.450220 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c267-1e27-468f-9cac-af9298b63c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.450495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c267-1e27-468f-9cac-af9298b63c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.450771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c267-1e27-468f-9cac-af9298b63c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.451494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140c267-1e27-468f-9cac-af9298b63c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:27.453828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140c267-1e27-468f-9cac-af9298b63c9a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:27.464590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1176/2358] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:42:27.469212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15391-f21e-45d7-81a9-bc812a74e1f8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:27.479178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15391-f21e-45d7-81a9-bc812a74e1f8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:27.483735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a2ebf-8d1a-4fee-8071-86e40707abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:27.484640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a2ebf-8d1a-4fee-8071-86e40707abf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.484923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a2ebf-8d1a-4fee-8071-86e40707abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.485195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a2ebf-8d1a-4fee-8071-86e40707abf8 admin admin] PATH_INFO: `/v3/projects/fa783e037ac8493eb3e3b197967ea571/users/103987a42fea4474ad9df7b02fc1c45f/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.508342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a2ebf-8d1a-4fee-8071-86e40707abf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa783e037ac8493eb3e3b197967ea571, user_id=103987a42fea4474ad9df7b02fc1c45f, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:27.512155 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a2ebf-8d1a-4fee-8071-86e40707abf8 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:27.576069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1183/2359] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:27 2022] PUT /identity/v3/projects/fa783e037ac8493eb3e3b197967ea571/users/103987a42fea4474ad9df7b02fc1c45f/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:27.588026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abbf4-6c13-4286-ba26-bac4de7992bf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.588347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abbf4-6c13-4286-ba26-bac4de7992bf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.588865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6abbf4-6c13-4286-ba26-bac4de7992bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.618049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7b6abbf4-6c13-4286-ba26-bac4de7992bf None None] MFA Rules not processed for user `103987a42fea4474ad9df7b02fc1c45f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:27.619123 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7b6abbf4-6c13-4286-ba26-bac4de7992bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:27.684539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1177/2360] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:27.688885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a2ebf-8d1a-4fee-8071-86e40707abf8 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:27.774228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a2ebf-8d1a-4fee-8071-86e40707abf8 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:27.781191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3212a9-d503-44dc-80b7-3e9be0a9532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:27.782094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3212a9-d503-44dc-80b7-3e9be0a9532e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.782371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3212a9-d503-44dc-80b7-3e9be0a9532e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.782640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3212a9-d503-44dc-80b7-3e9be0a9532e admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.783333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3212a9-d503-44dc-80b7-3e9be0a9532e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:27.785387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3212a9-d503-44dc-80b7-3e9be0a9532e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:27.813654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff614b6-b045-4cff-b4df-6194b388c458 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.813654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff614b6-b045-4cff-b4df-6194b388c458 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.813654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff614b6-b045-4cff-b4df-6194b388c458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.844062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8ff614b6-b045-4cff-b4df-6194b388c458 None None] MFA Rules not processed for user `b7de51e3989248088b608a5d50400064`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:27.845898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8ff614b6-b045-4cff-b4df-6194b388c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:27.894701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:27.926533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1184/2361] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:27 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:27.927340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1178/2362] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:27.928007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3212a9-d503-44dc-80b7-3e9be0a9532e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:27.942519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff614b6-b045-4cff-b4df-6194b388c458 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:27.943326 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:27.943962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8ff614b6-b045-4cff-b4df-6194b388c458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:27.990267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3212a9-d503-44dc-80b7-3e9be0a9532e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:27.995071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef47a-1ab5-4fa6-b395-8fb1be1cc442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:27.995733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef47a-1ab5-4fa6-b395-8fb1be1cc442 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:27.996038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef47a-1ab5-4fa6-b395-8fb1be1cc442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:27.996312 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef47a-1ab5-4fa6-b395-8fb1be1cc442 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:27.996995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef47a-1ab5-4fa6-b395-8fb1be1cc442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:27.998912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef47a-1ab5-4fa6-b395-8fb1be1cc442 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:28.004240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff614b6-b045-4cff-b4df-6194b388c458 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:28.054152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783e962-923e-4580-bd53-9997e736f0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:28.054789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783e962-923e-4580-bd53-9997e736f0dc service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:28.055069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783e962-923e-4580-bd53-9997e736f0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:28.055340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783e962-923e-4580-bd53-9997e736f0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:28.088846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1185/2363] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:27 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:28.092799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef47a-1ab5-4fa6-b395-8fb1be1cc442 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:28.104039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef47a-1ab5-4fa6-b395-8fb1be1cc442 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:28.109435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4476354-52de-4a80-9b6f-ecff62885f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:28.110116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476354-52de-4a80-9b6f-ecff62885f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:28.110407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476354-52de-4a80-9b6f-ecff62885f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:28.111258 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476354-52de-4a80-9b6f-ecff62885f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:28.111411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4476354-52de-4a80-9b6f-ecff62885f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:28.113169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4476354-52de-4a80-9b6f-ecff62885f0a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:28.114873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783e962-923e-4580-bd53-9997e736f0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:28.116648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783e962-923e-4580-bd53-9997e736f0dc service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:28.128480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1186/2364] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:42:28.131036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1179/2365] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:42:28.132051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4476354-52de-4a80-9b6f-ecff62885f0a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:28.142797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4476354-52de-4a80-9b6f-ecff62885f0a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:28.150073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1594bc-ba92-4b52-bcd6-c09318a52518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:28.151027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1594bc-ba92-4b52-bcd6-c09318a52518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:28.151380 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1594bc-ba92-4b52-bcd6-c09318a52518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:28.151730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1594bc-ba92-4b52-bcd6-c09318a52518 admin admin] PATH_INFO: `/v3/projects/0e44188a46ae49db941bdfec8b9a6f33/users/f218787d8b5c44deaaede43624b2145b/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:28.169776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1594bc-ba92-4b52-bcd6-c09318a52518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e44188a46ae49db941bdfec8b9a6f33, user_id=f218787d8b5c44deaaede43624b2145b, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:28.173035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1594bc-ba92-4b52-bcd6-c09318a52518 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:28.238020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1187/2366] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:28 2022] PUT /identity/v3/projects/0e44188a46ae49db941bdfec8b9a6f33/users/f218787d8b5c44deaaede43624b2145b/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:28.242290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783e962-923e-4580-bd53-9997e736f0dc service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:28.253584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783e962-923e-4580-bd53-9997e736f0dc service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:28.305025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:28.317648 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187600c0-8576-47de-b410-9714ae906230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:28.318317 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187600c0-8576-47de-b410-9714ae906230 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:28.318597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187600c0-8576-47de-b410-9714ae906230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:28.318870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187600c0-8576-47de-b410-9714ae906230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:28.319598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187600c0-8576-47de-b410-9714ae906230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:28.321304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187600c0-8576-47de-b410-9714ae906230 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:28.331476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1180/2367] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:28.335324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1594bc-ba92-4b52-bcd6-c09318a52518 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:28.347650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1594bc-ba92-4b52-bcd6-c09318a52518 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:28.352314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:28.353179 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:28.353461 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:28.353740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] PATH_INFO: `/v3/projects/0e44188a46ae49db941bdfec8b9a6f33/users/f218787d8b5c44deaaede43624b2145b/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:28.355708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e44188a46ae49db941bdfec8b9a6f33, user_id=f218787d8b5c44deaaede43624b2145b, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:28.358372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:28.369217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1188/2368] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:28 2022] PUT /identity/v3/projects/0e44188a46ae49db941bdfec8b9a6f33/users/f218787d8b5c44deaaede43624b2145b/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:28.379209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5e1d8-fee1-4ab8-80b2-aeee2a08973e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:28.379500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5e1d8-fee1-4ab8-80b2-aeee2a08973e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:28.379785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5e1d8-fee1-4ab8-80b2-aeee2a08973e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:28.411301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-63d5e1d8-fee1-4ab8-80b2-aeee2a08973e None None] MFA Rules not processed for user `f218787d8b5c44deaaede43624b2145b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:28.412583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-63d5e1d8-fee1-4ab8-80b2-aeee2a08973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:28.495507 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1181/2369] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:28.507475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:28.509207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:28.567293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412b83a-a16c-4c3d-8d53-14ab611a9f7e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:28.570893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b14f-f3b9-4fc0-9b37-6ba99b324ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:28.571527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b14f-f3b9-4fc0-9b37-6ba99b324ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:28.571803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b14f-f3b9-4fc0-9b37-6ba99b324ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:28.572111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b14f-f3b9-4fc0-9b37-6ba99b324ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:28.631805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b14f-f3b9-4fc0-9b37-6ba99b324ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:28.633297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b14f-f3b9-4fc0-9b37-6ba99b324ed7 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:28.642368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1189/2370] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:29.930423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53112c6a-0859-4a3d-bd6f-03d17fdc9cb8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:29.936593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53112c6a-0859-4a3d-bd6f-03d17fdc9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:29.936593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53112c6a-0859-4a3d-bd6f-03d17fdc9cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:29.950084 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-53112c6a-0859-4a3d-bd6f-03d17fdc9cb8 None None] MFA Rules not processed for user `b7de51e3989248088b608a5d50400064`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:29.951284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53112c6a-0859-4a3d-bd6f-03d17fdc9cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:30.009847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1182/2371] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:30.674397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b14f-f3b9-4fc0-9b37-6ba99b324ed7 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:30.684485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b14f-f3b9-4fc0-9b37-6ba99b324ed7 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:30.689623 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed9f7-d4ac-40ea-9667-24a3d2a14db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:30.690350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed9f7-d4ac-40ea-9667-24a3d2a14db1 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:30.690937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed9f7-d4ac-40ea-9667-24a3d2a14db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:30.691321 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed9f7-d4ac-40ea-9667-24a3d2a14db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:30.699252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:30.758772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ed9f7-d4ac-40ea-9667-24a3d2a14db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:30.760742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ed9f7-d4ac-40ea-9667-24a3d2a14db1 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:30.772596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1190/2372] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:32.243613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53112c6a-0859-4a3d-bd6f-03d17fdc9cb8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:32.253492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53112c6a-0859-4a3d-bd6f-03d17fdc9cb8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:32.257205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f029e6-9036-48f7-b306-4add5bd1b5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:32.257909 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f029e6-9036-48f7-b306-4add5bd1b5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:32.258262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f029e6-9036-48f7-b306-4add5bd1b5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:32.258535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f029e6-9036-48f7-b306-4add5bd1b5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:32.269032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f029e6-9036-48f7-b306-4add5bd1b5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:32.271264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f029e6-9036-48f7-b306-4add5bd1b5c7 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:32.281151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1183/2373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:37.979576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed9f7-d4ac-40ea-9667-24a3d2a14db1 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:38.039144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed9f7-d4ac-40ea-9667-24a3d2a14db1 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:38.043560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:38.044451 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:38.044737 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:38.045008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] PATH_INFO: `/v3/users/40690e55b6bd451bb74cd64f0ec865f9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:38.046697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40690e55b6bd451bb74cd64f0ec865f9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:38.048630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:38.261533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40690e55b6bd451bb74cd64f0ec865f9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:38.269334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40690e55b6bd451bb74cd64f0ec865f9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:38.345904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40690e55b6bd451bb74cd64f0ec865f9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:38.346633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40690e55b6bd451bb74cd64f0ec865f9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:38.366212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40690e55b6bd451bb74cd64f0ec865f9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:38.392821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1191/2374] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:37 2022] DELETE /identity/v3/users/40690e55b6bd451bb74cd64f0ec865f9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:38.397404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16498cd-10f4-4e94-9a8f-f3f05b5430b7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:38.397946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16498cd-10f4-4e94-9a8f-f3f05b5430b7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:38.397946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16498cd-10f4-4e94-9a8f-f3f05b5430b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:38.445342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e16498cd-10f4-4e94-9a8f-f3f05b5430b7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:38.445930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e16498cd-10f4-4e94-9a8f-f3f05b5430b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:38.514137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1184/2375] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:38.524866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:38.526348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:38.560220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:38.589678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcd5b5-ee39-4995-b4d9-e2ebdf8530b4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:38.594854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8cc19-ad92-43e2-8c5c-59c05d74864d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:38.595799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8cc19-ad92-43e2-8c5c-59c05d74864d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:38.596318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8cc19-ad92-43e2-8c5c-59c05d74864d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:38.606044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8cc19-ad92-43e2-8c5c-59c05d74864d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:38.606888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8cc19-ad92-43e2-8c5c-59c05d74864d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:38.608501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8cc19-ad92-43e2-8c5c-59c05d74864d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:38.618854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1192/2376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:39.027438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16498cd-10f4-4e94-9a8f-f3f05b5430b7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:39.028945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e16498cd-10f4-4e94-9a8f-f3f05b5430b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:39.035963 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:39.041649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16498cd-10f4-4e94-9a8f-f3f05b5430b7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:39.052983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:39.052983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:39.052983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:39.052983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] PATH_INFO: `/v3/projects/cd3689a8b5084a4bb2c147ba950d90b6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:39.053421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3689a8b5084a4bb2c147ba950d90b6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:39.053421 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:39.165240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3689a8b5084a4bb2c147ba950d90b6', 'request_id': 'req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.172810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3689a8b5084a4bb2c147ba950d90b6', 'request_id': 'req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.179086 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3689a8b5084a4bb2c147ba950d90b6', 'request_id': 'req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.248015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] The token cache is being invalidate because project cd3689a8b5084a4bb2c147ba950d90b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:39.248312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.249546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.251096 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1185/2377] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:39 2022] DELETE /identity/v3/projects/cd3689a8b5084a4bb2c147ba950d90b6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:39.255490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8cc19-ad92-43e2-8c5c-59c05d74864d service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:39.265014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8cc19-ad92-43e2-8c5c-59c05d74864d service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:39.326747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:39.327682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:39.328006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:39.328267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] PATH_INFO: `/v3/users/103987a42fea4474ad9df7b02fc1c45f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:39.329453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] RBAC: Authorizing `identity:delete_user(user_id=103987a42fea4474ad9df7b02fc1c45f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:39.331423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:39.576758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103987a42fea4474ad9df7b02fc1c45f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.590285 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103987a42fea4474ad9df7b02fc1c45f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.674762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103987a42fea4474ad9df7b02fc1c45f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.674762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103987a42fea4474ad9df7b02fc1c45f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.688385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103987a42fea4474ad9df7b02fc1c45f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:39.694804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1193/2378] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:39 2022] DELETE /identity/v3/users/103987a42fea4474ad9df7b02fc1c45f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:40.198458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:40.202765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:40.216208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bad1ff-a885-4f0b-86ef-312ca4a5684f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:40.285485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:40.286437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:40.286876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:40.287163 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] PATH_INFO: `/v3/projects/fa783e037ac8493eb3e3b197967ea571` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:40.288452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa783e037ac8493eb3e3b197967ea571)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:40.290360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:40.393678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa783e037ac8493eb3e3b197967ea571', 'request_id': 'req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.399599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa783e037ac8493eb3e3b197967ea571', 'request_id': 'req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.406355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa783e037ac8493eb3e3b197967ea571', 'request_id': 'req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.493847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] The token cache is being invalidate because project fa783e037ac8493eb3e3b197967ea571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:40.494160 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.494832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.496788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1186/2379] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:40 2022] DELETE /identity/v3/projects/fa783e037ac8493eb3e3b197967ea571 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:40.501417 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:40.502956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:40.516860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe9952-78d3-4924-a269-c8ddd45e600c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:40.568432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:40.596144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:40.596144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:40.596144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:40.596144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] PATH_INFO: `/v3/users/f218787d8b5c44deaaede43624b2145b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:40.596614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f218787d8b5c44deaaede43624b2145b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:40.597458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:40.874711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f218787d8b5c44deaaede43624b2145b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.881943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f218787d8b5c44deaaede43624b2145b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.952453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f218787d8b5c44deaaede43624b2145b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.955452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f218787d8b5c44deaaede43624b2145b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.979103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f218787d8b5c44deaaede43624b2145b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:40.991339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1194/2380] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:40 2022] DELETE /identity/v3/users/f218787d8b5c44deaaede43624b2145b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:42:41.347954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:41.349401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:41.362167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc2dc3-5514-48d9-ad2d-b69adbe1a388 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:41.373531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:41.419429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:41.420327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:41.420636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:41.420916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] PATH_INFO: `/v3/users/f776741beb5642428f3ad31ea5090ccb` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:41.422111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f776741beb5642428f3ad31ea5090ccb)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:41.424260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:41.443381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:41.445037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:41.461646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c854-f2aa-455b-abf7-062ee33ef091 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:41.466501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:41.469816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:41.469816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:41.469816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] PATH_INFO: `/v3/projects/0e44188a46ae49db941bdfec8b9a6f33` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:41.469816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e44188a46ae49db941bdfec8b9a6f33)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:41.471774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:41.720349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f776741beb5642428f3ad31ea5090ccb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.757630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e44188a46ae49db941bdfec8b9a6f33', 'request_id': 'req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.765985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e44188a46ae49db941bdfec8b9a6f33', 'request_id': 'req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.772905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e44188a46ae49db941bdfec8b9a6f33', 'request_id': 'req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.792928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f776741beb5642428f3ad31ea5090ccb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.806886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f776741beb5642428f3ad31ea5090ccb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.807624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f776741beb5642428f3ad31ea5090ccb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.815151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-31857496-34cb-4118-9aef-1bd0f121adb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f776741beb5642428f3ad31ea5090ccb'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.822882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1187/2381] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:41 2022] DELETE /identity/v3/users/f776741beb5642428f3ad31ea5090ccb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:41.828180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e767f2f-e3a6-4b3d-b5b5-afec8d162545 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:41.828691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e767f2f-e3a6-4b3d-b5b5-afec8d162545 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:41.829184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e767f2f-e3a6-4b3d-b5b5-afec8d162545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:41.851315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3e767f2f-e3a6-4b3d-b5b5-afec8d162545 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:41.853137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e767f2f-e3a6-4b3d-b5b5-afec8d162545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:41.897796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] The token cache is being invalidate because project 0e44188a46ae49db941bdfec8b9a6f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:41.901753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.901753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-7c1c8a88-cfb5-4ed7-9c07-4e998a9401e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:41.901753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1195/2382] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:41 2022] DELETE /identity/v3/projects/0e44188a46ae49db941bdfec8b9a6f33 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:41.905155 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4784b5-684d-4b04-aaa7-1e208befa395 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:41.905435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4784b5-684d-4b04-aaa7-1e208befa395 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:41.905726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4784b5-684d-4b04-aaa7-1e208befa395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:41.915792 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1188/2383] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:41.924971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-5b4784b5-684d-4b04-aaa7-1e208befa395 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:41.925386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e767f2f-e3a6-4b3d-b5b5-afec8d162545 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:41.926534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5b4784b5-684d-4b04-aaa7-1e208befa395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:41.926789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e767f2f-e3a6-4b3d-b5b5-afec8d162545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:41.934638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1196/2384] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:41.944674 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ad5c2-b1aa-46e1-be79-f79f8eed8433 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:41.944968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ad5c2-b1aa-46e1-be79-f79f8eed8433 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:41.945252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ad5c2-b1aa-46e1-be79-f79f8eed8433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:41.967230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d36ad5c2-b1aa-46e1-be79-f79f8eed8433 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:41.968612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d36ad5c2-b1aa-46e1-be79-f79f8eed8433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:41.983839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1197/2385] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:41.984844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ad5c2-b1aa-46e1-be79-f79f8eed8433 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:41.996158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ad5c2-b1aa-46e1-be79-f79f8eed8433 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.000011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e767f2f-e3a6-4b3d-b5b5-afec8d162545 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.001988 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.002660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.002943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.003408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.003889 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9419-5f56-419d-83d6-37d8d5b01eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.004310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:42:42.004578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9419-5f56-419d-83d6-37d8d5b01eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.004864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9419-5f56-419d-83d6-37d8d5b01eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.005144 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9419-5f56-419d-83d6-37d8d5b01eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.005372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.007185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.018343 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d9419-5f56-419d-83d6-37d8d5b01eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.019073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d9419-5f56-419d-83d6-37d8d5b01eb8 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.027955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1198/2386] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:42:42.029033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:42.035304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1189/2387] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:42:42.040829 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce1508-2e2c-4661-9a59-a924085b264d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.047106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617941d-adc0-4dc4-8f56-04a426d231a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.047766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617941d-adc0-4dc4-8f56-04a426d231a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.048100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617941d-adc0-4dc4-8f56-04a426d231a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.048416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617941d-adc0-4dc4-8f56-04a426d231a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.049111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617941d-adc0-4dc4-8f56-04a426d231a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.051194 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617941d-adc0-4dc4-8f56-04a426d231a1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.182147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1199/2388] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:42 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:42.183283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9419-5f56-419d-83d6-37d8d5b01eb8 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:42.194282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9419-5f56-419d-83d6-37d8d5b01eb8 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.261445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b0fad-89da-49f2-9005-7951d96eaa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.262282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b0fad-89da-49f2-9005-7951d96eaa5e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.262739 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b0fad-89da-49f2-9005-7951d96eaa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.263262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b0fad-89da-49f2-9005-7951d96eaa5e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.264480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b0fad-89da-49f2-9005-7951d96eaa5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.266492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b0fad-89da-49f2-9005-7951d96eaa5e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.368209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1190/2389] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:42 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:42.374196 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617941d-adc0-4dc4-8f56-04a426d231a1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:42.380058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:42.387870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617941d-adc0-4dc4-8f56-04a426d231a1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.394761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520c322-8b08-4d88-bcb9-911d4bce6bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.395579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520c322-8b08-4d88-bcb9-911d4bce6bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.395952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520c322-8b08-4d88-bcb9-911d4bce6bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.396290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520c322-8b08-4d88-bcb9-911d4bce6bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.397033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520c322-8b08-4d88-bcb9-911d4bce6bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.399750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520c322-8b08-4d88-bcb9-911d4bce6bb7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.411961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1200/2390] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:42.416254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b0fad-89da-49f2-9005-7951d96eaa5e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:42.435285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b0fad-89da-49f2-9005-7951d96eaa5e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.443066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c81603-d16e-4e61-8873-f7688cb38183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.445094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c81603-d16e-4e61-8873-f7688cb38183 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.445683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c81603-d16e-4e61-8873-f7688cb38183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.446259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c81603-d16e-4e61-8873-f7688cb38183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.455103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c81603-d16e-4e61-8873-f7688cb38183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.455103 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c81603-d16e-4e61-8873-f7688cb38183 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.464271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1191/2391] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:42.469004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520c322-8b08-4d88-bcb9-911d4bce6bb7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:42.483671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520c322-8b08-4d88-bcb9-911d4bce6bb7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.493981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.495030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.495315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.495623 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] PATH_INFO: `/v3/projects/a2e13c8ba960469fb69a65328e70a666/users/87b322a5c52a4eff9cc9b3d2521e7ba6/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.515777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e13c8ba960469fb69a65328e70a666, user_id=87b322a5c52a4eff9cc9b3d2521e7ba6, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.520372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.655279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1201/2392] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:42 2022] PUT /identity/v3/projects/a2e13c8ba960469fb69a65328e70a666/users/87b322a5c52a4eff9cc9b3d2521e7ba6/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:42.666498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6de6-27b7-4ec7-8681-cc9e93e2d22f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.667017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6de6-27b7-4ec7-8681-cc9e93e2d22f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.667300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6de6-27b7-4ec7-8681-cc9e93e2d22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.696921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-745e6de6-27b7-4ec7-8681-cc9e93e2d22f None None] MFA Rules not processed for user `87b322a5c52a4eff9cc9b3d2521e7ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:42.698194 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-745e6de6-27b7-4ec7-8681-cc9e93e2d22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:42.745944 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:42.749712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:42.763853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:42.806670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1192/2393] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:42.823722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6de6-27b7-4ec7-8681-cc9e93e2d22f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:42.825980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-745e6de6-27b7-4ec7-8681-cc9e93e2d22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:42.865429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df28d8b-aebd-4ade-9d38-0fcd735ceb7f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.872333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.878041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.886278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.886700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] PATH_INFO: `/v3/projects/da43fb5efa7449568376d452bda0b9b5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.892643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=da43fb5efa7449568376d452bda0b9b5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.895403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.901631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6de6-27b7-4ec7-8681-cc9e93e2d22f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:42.909020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dd229-9ac4-4492-8745-d1d6c3af130b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d6317775c343eaa9397254074647f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:42.909959 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dd229-9ac4-4492-8745-d1d6c3af130b service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:42.910473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dd229-9ac4-4492-8745-d1d6c3af130b service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:42.910946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dd229-9ac4-4492-8745-d1d6c3af130b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:42.922864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dd229-9ac4-4492-8745-d1d6c3af130b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:42.925656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dd229-9ac4-4492-8745-d1d6c3af130b service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:42.944578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1193/2394] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:42:43.101655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da43fb5efa7449568376d452bda0b9b5', 'request_id': 'req-ac441838-eb6e-47f2-98be-a26a3560d22f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:43.107688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da43fb5efa7449568376d452bda0b9b5', 'request_id': 'req-ac441838-eb6e-47f2-98be-a26a3560d22f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:43.123122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da43fb5efa7449568376d452bda0b9b5', 'request_id': 'req-ac441838-eb6e-47f2-98be-a26a3560d22f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:43.232018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] The token cache is being invalidate because project da43fb5efa7449568376d452bda0b9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:43.232313 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:43.233121 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac441838-eb6e-47f2-98be-a26a3560d22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:43.235361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1202/2395] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:42 2022] DELETE /identity/v3/projects/da43fb5efa7449568376d452bda0b9b5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:43.241462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6dea0-4a7a-4d0d-b9ea-d190c63739fc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:43.242146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6dea0-4a7a-4d0d-b9ea-d190c63739fc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:43.242426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6dea0-4a7a-4d0d-b9ea-d190c63739fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:43.265092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9fc6dea0-4a7a-4d0d-b9ea-d190c63739fc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:43.266864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9fc6dea0-4a7a-4d0d-b9ea-d190c63739fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:43.369496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1194/2396] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:43.377687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252c3ad-4ad9-4257-9816-95b375a0061a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:43.378315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252c3ad-4ad9-4257-9816-95b375a0061a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:43.378665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252c3ad-4ad9-4257-9816-95b375a0061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:43.398759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6252c3ad-4ad9-4257-9816-95b375a0061a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:43.399979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6252c3ad-4ad9-4257-9816-95b375a0061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:43.408043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1203/2397] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:43.412164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6dea0-4a7a-4d0d-b9ea-d190c63739fc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:43.421797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6dea0-4a7a-4d0d-b9ea-d190c63739fc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:43.427576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:43.428796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:43.429056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:43.429518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:43.430465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:42:43.431332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:43.433155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:43.446109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1195/2398] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:42:43.450431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252c3ad-4ad9-4257-9816-95b375a0061a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:43.462733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252c3ad-4ad9-4257-9816-95b375a0061a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:43.468259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a8dec-a02e-42d9-98fb-53a11f909237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:43.468918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8dec-a02e-42d9-98fb-53a11f909237 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:43.469647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8dec-a02e-42d9-98fb-53a11f909237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:43.469926 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a8dec-a02e-42d9-98fb-53a11f909237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:43.470624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a8dec-a02e-42d9-98fb-53a11f909237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:43.473125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a8dec-a02e-42d9-98fb-53a11f909237 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:43.629305 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1204/2399] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:43 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:43.635004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:43.696736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04baa12b-f943-49e8-853c-0b735aaff78a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:43.773235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ede5b-3665-4a63-8e2c-5f275155f284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:43.773921 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ede5b-3665-4a63-8e2c-5f275155f284 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:43.774245 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ede5b-3665-4a63-8e2c-5f275155f284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:43.774524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ede5b-3665-4a63-8e2c-5f275155f284 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:43.775240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ede5b-3665-4a63-8e2c-5f275155f284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:43.777232 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ede5b-3665-4a63-8e2c-5f275155f284 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:43.913882 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1196/2400] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:43 2022] POST /identity/v3/users => generated 292 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:42:43.914900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a8dec-a02e-42d9-98fb-53a11f909237 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:43.959700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a8dec-a02e-42d9-98fb-53a11f909237 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:43.964254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61e70d-db0a-45d6-ab53-2bb4b1e24e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:43.964914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61e70d-db0a-45d6-ab53-2bb4b1e24e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:43.965181 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61e70d-db0a-45d6-ab53-2bb4b1e24e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:43.965452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61e70d-db0a-45d6-ab53-2bb4b1e24e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:43.966174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61e70d-db0a-45d6-ab53-2bb4b1e24e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:43.968284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61e70d-db0a-45d6-ab53-2bb4b1e24e5e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:43.978429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1205/2401] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:43.982275 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ede5b-3665-4a63-8e2c-5f275155f284 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:43.993855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ede5b-3665-4a63-8e2c-5f275155f284 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:43.998988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a96bc-3400-4c6c-b2d5-2f4edd8b38a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:43.999834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a96bc-3400-4c6c-b2d5-2f4edd8b38a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:44.000177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a96bc-3400-4c6c-b2d5-2f4edd8b38a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:44.006373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a96bc-3400-4c6c-b2d5-2f4edd8b38a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:44.006373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a96bc-3400-4c6c-b2d5-2f4edd8b38a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:44.006373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a96bc-3400-4c6c-b2d5-2f4edd8b38a7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:44.026802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1197/2402] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:42:44.028148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61e70d-db0a-45d6-ab53-2bb4b1e24e5e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:44.039342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61e70d-db0a-45d6-ab53-2bb4b1e24e5e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:44.044162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:44.045137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:44.046104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:44.046454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] PATH_INFO: `/v3/projects/ac60840fcd7648a7a5b2fb91849877e4/users/6954216f11504217823fa6551c57fad5/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:44.067584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac60840fcd7648a7a5b2fb91849877e4, user_id=6954216f11504217823fa6551c57fad5, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:44.070331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:44.149815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1206/2403] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:44 2022] PUT /identity/v3/projects/ac60840fcd7648a7a5b2fb91849877e4/users/6954216f11504217823fa6551c57fad5/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:44.164499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16931a5a-fd18-4d42-a055-8accfb8cf7f2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:44.164922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16931a5a-fd18-4d42-a055-8accfb8cf7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:44.165330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16931a5a-fd18-4d42-a055-8accfb8cf7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:44.195978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-16931a5a-fd18-4d42-a055-8accfb8cf7f2 None None] MFA Rules not processed for user `6954216f11504217823fa6551c57fad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:44.197219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-16931a5a-fd18-4d42-a055-8accfb8cf7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:44.270054 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1198/2404] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:42:44.281645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:44.283408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:44.362980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c176567-6ada-4e28-ab93-33ab1ac008f5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:44.366551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9fb3-af13-4ea8-bb86-b81762fe238b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:44.367453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9fb3-af13-4ea8-bb86-b81762fe238b service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:44.367748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9fb3-af13-4ea8-bb86-b81762fe238b service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:44.368103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9fb3-af13-4ea8-bb86-b81762fe238b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:44.376513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d9fb3-af13-4ea8-bb86-b81762fe238b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:44.378066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d9fb3-af13-4ea8-bb86-b81762fe238b service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:44.387071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1207/2405] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:44.538923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:44.837161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:44.937824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87101-21dc-4d0f-8631-8ece3c31ebae None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:44.938291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87101-21dc-4d0f-8631-8ece3c31ebae None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:44.938728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87101-21dc-4d0f-8631-8ece3c31ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:44.977215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4dd87101-21dc-4d0f-8631-8ece3c31ebae None None] MFA Rules not processed for user `4989693e66c44d6a8e5f8543f1b9c516`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:44.978976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4dd87101-21dc-4d0f-8631-8ece3c31ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:45.096259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1199/2406] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:45.940209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:54.773943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9fb3-af13-4ea8-bb86-b81762fe238b service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:54.864594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9fb3-af13-4ea8-bb86-b81762fe238b service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:54.871639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:54.874099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:54.874099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:54.874540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] PATH_INFO: `/v3/users/6954216f11504217823fa6551c57fad5` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:54.875889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6954216f11504217823fa6551c57fad5)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:54.878493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:55.083712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:55.091247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6954216f11504217823fa6551c57fad5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:55.099856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6954216f11504217823fa6551c57fad5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:55.145827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6954216f11504217823fa6551c57fad5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:55.146045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6954216f11504217823fa6551c57fad5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:55.168630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6954216f11504217823fa6551c57fad5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:55.174607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1208/2407] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:42:54 2022] DELETE /identity/v3/users/6954216f11504217823fa6551c57fad5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:55.179178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c61cc4-387e-41f5-8d47-b0bf664a8749 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:55.179631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c61cc4-387e-41f5-8d47-b0bf664a8749 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:55.179722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c61cc4-387e-41f5-8d47-b0bf664a8749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:55.210061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-88c61cc4-387e-41f5-8d47-b0bf664a8749 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:55.211305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88c61cc4-387e-41f5-8d47-b0bf664a8749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:55.309520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1200/2408] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:55.327474 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:55.329043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:55.434807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c33b32-4b5a-48b6-bc62-4284710fb597 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:55.438933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1267d2e-18d0-4413-8e84-d749cda8284e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:55.439586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267d2e-18d0-4413-8e84-d749cda8284e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:55.440203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267d2e-18d0-4413-8e84-d749cda8284e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:55.440203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267d2e-18d0-4413-8e84-d749cda8284e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:55.449727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1267d2e-18d0-4413-8e84-d749cda8284e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:55.451296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1267d2e-18d0-4413-8e84-d749cda8284e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:55.463930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1209/2409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:56.018975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c61cc4-387e-41f5-8d47-b0bf664a8749 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:56.020910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88c61cc4-387e-41f5-8d47-b0bf664a8749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:56.036764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c61cc4-387e-41f5-8d47-b0bf664a8749 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:56.052452 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:56.053336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.053644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.053913 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] PATH_INFO: `/v3/projects/ac60840fcd7648a7a5b2fb91849877e4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.055750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac60840fcd7648a7a5b2fb91849877e4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:56.057714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:56.205588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:56.218255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac60840fcd7648a7a5b2fb91849877e4', 'request_id': 'req-f8ac22ad-7728-4eee-89c0-45f5e936b716'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:56.223721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac60840fcd7648a7a5b2fb91849877e4', 'request_id': 'req-f8ac22ad-7728-4eee-89c0-45f5e936b716'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:56.230364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac60840fcd7648a7a5b2fb91849877e4', 'request_id': 'req-f8ac22ad-7728-4eee-89c0-45f5e936b716'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:56.304390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] The token cache is being invalidate because project ac60840fcd7648a7a5b2fb91849877e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:42:56.304677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:56.305444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f8ac22ad-7728-4eee-89c0-45f5e936b716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:42:56.306995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1201/2410] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:42:56 2022] DELETE /identity/v3/projects/ac60840fcd7648a7a5b2fb91849877e4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:56.311858 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40b0e2-b764-4ad9-88cc-c7534b0cba24 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.312856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40b0e2-b764-4ad9-88cc-c7534b0cba24 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.313019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40b0e2-b764-4ad9-88cc-c7534b0cba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.348830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4a40b0e2-b764-4ad9-88cc-c7534b0cba24 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:56.350077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4a40b0e2-b764-4ad9-88cc-c7534b0cba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:56.409284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1210/2411] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:56.418358 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e8377-4d30-4ee2-b93e-8f61ff01190a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.418749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e8377-4d30-4ee2-b93e-8f61ff01190a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.419742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e8377-4d30-4ee2-b93e-8f61ff01190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.439593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ea5e8377-4d30-4ee2-b93e-8f61ff01190a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:56.441139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ea5e8377-4d30-4ee2-b93e-8f61ff01190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:56.452007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1202/2412] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:56.455017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40b0e2-b764-4ad9-88cc-c7534b0cba24 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:56.465695 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40b0e2-b764-4ad9-88cc-c7534b0cba24 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:56.471649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:56.472514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.472914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.473276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.474833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:42:56.474833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:56.477807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:56.492430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1211/2413] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:42:56.496465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e8377-4d30-4ee2-b93e-8f61ff01190a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:56.506372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e8377-4d30-4ee2-b93e-8f61ff01190a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:56.512289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762feb90-7bb8-4251-b888-bd2cb467961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:56.512971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762feb90-7bb8-4251-b888-bd2cb467961d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.513273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762feb90-7bb8-4251-b888-bd2cb467961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.513598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762feb90-7bb8-4251-b888-bd2cb467961d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.514322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762feb90-7bb8-4251-b888-bd2cb467961d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:56.516423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762feb90-7bb8-4251-b888-bd2cb467961d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:56.625190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1203/2414] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:42:56 2022] POST /identity/v3/projects => generated 397 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:42:56.629190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:56.639511 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d9149-62c1-4995-9966-f683a3bb94a6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:56.647341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:56.695134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aca36-13d9-4314-9bc1-5eedbd23e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:56.695805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aca36-13d9-4314-9bc1-5eedbd23e660 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.696125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aca36-13d9-4314-9bc1-5eedbd23e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.696400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aca36-13d9-4314-9bc1-5eedbd23e660 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.697120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9aca36-13d9-4314-9bc1-5eedbd23e660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:56.699039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9aca36-13d9-4314-9bc1-5eedbd23e660 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:56.820361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1212/2415] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:42:56 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:42:56.824396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762feb90-7bb8-4251-b888-bd2cb467961d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:56.834714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762feb90-7bb8-4251-b888-bd2cb467961d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:56.839250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07146c-d55f-48ae-84f7-dcb97ae701e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:56.839901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07146c-d55f-48ae-84f7-dcb97ae701e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.840226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07146c-d55f-48ae-84f7-dcb97ae701e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.840586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07146c-d55f-48ae-84f7-dcb97ae701e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.841293 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07146c-d55f-48ae-84f7-dcb97ae701e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:56.842900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07146c-d55f-48ae-84f7-dcb97ae701e1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:56.853712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1204/2416] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:56.863068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aca36-13d9-4314-9bc1-5eedbd23e660 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:56.873114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aca36-13d9-4314-9bc1-5eedbd23e660 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:56.877623 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8df63-7fc5-4df7-a9a9-1b1a29b89547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:56.878276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8df63-7fc5-4df7-a9a9-1b1a29b89547 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.878554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8df63-7fc5-4df7-a9a9-1b1a29b89547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.878825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8df63-7fc5-4df7-a9a9-1b1a29b89547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.879543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8df63-7fc5-4df7-a9a9-1b1a29b89547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:56.881175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8df63-7fc5-4df7-a9a9-1b1a29b89547 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:56.893591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1213/2417] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:42:56.897783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07146c-d55f-48ae-84f7-dcb97ae701e1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:56.908524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07146c-d55f-48ae-84f7-dcb97ae701e1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:56.913767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:56.917002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:56.917002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:56.917002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] PATH_INFO: `/v3/projects/6d40b17dc23043d2aff58fe4cda3eaa0/users/0b71260ce1664d5789427c2a4f26728b/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:56.932010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d40b17dc23043d2aff58fe4cda3eaa0, user_id=0b71260ce1664d5789427c2a4f26728b, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:56.934765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:56.991328 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1205/2418] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:42:56 2022] PUT /identity/v3/projects/6d40b17dc23043d2aff58fe4cda3eaa0/users/0b71260ce1664d5789427c2a4f26728b/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:42:57.001811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe0a55-70c1-4f44-a365-39ec90c95533 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:57.002115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe0a55-70c1-4f44-a365-39ec90c95533 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:57.002393 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe0a55-70c1-4f44-a365-39ec90c95533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:57.029632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-61fe0a55-70c1-4f44-a365-39ec90c95533 None None] MFA Rules not processed for user `0b71260ce1664d5789427c2a4f26728b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:57.031377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-61fe0a55-70c1-4f44-a365-39ec90c95533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:57.108383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1214/2419] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:57.119689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:57.121559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:57.182937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4176a-5d22-44b0-ba81-b15c30896d58 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:57.186867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b2413-5f8a-4461-b227-a805e9d4cbfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:57.187614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b2413-5f8a-4461-b227-a805e9d4cbfc service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:57.188000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b2413-5f8a-4461-b227-a805e9d4cbfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:57.188348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b2413-5f8a-4461-b227-a805e9d4cbfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:57.198984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b2413-5f8a-4461-b227-a805e9d4cbfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:57.200454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b2413-5f8a-4461-b227-a805e9d4cbfc service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:57.210305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1206/2420] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:58.316275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b3ed-6c12-4afe-ab24-22f9adbb7eee None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:58.316820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b3ed-6c12-4afe-ab24-22f9adbb7eee None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:58.316820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3b3ed-6c12-4afe-ab24-22f9adbb7eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:58.333894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a2f3b3ed-6c12-4afe-ab24-22f9adbb7eee None None] MFA Rules not processed for user `b7de51e3989248088b608a5d50400064`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:58.335126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a2f3b3ed-6c12-4afe-ab24-22f9adbb7eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:58.393193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1215/2421] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:42:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:05.476568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b73c5b-d4ff-4c02-82fc-476d3988f10d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:05.486118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b73c5b-d4ff-4c02-82fc-476d3988f10d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:05.486118 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b73c5b-d4ff-4c02-82fc-476d3988f10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:05.505937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f2b73c5b-d4ff-4c02-82fc-476d3988f10d None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:05.506935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f2b73c5b-d4ff-4c02-82fc-476d3988f10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:05.553130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:05.565574 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1207/2422] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:43:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:43:05.745470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3b3ed-6c12-4afe-ab24-22f9adbb7eee None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:05.747483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a2f3b3ed-6c12-4afe-ab24-22f9adbb7eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:05.778348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:05.828788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3b3ed-6c12-4afe-ab24-22f9adbb7eee None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:05.835719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e89af3-9f71-445f-b15a-27ef08725545 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:05.836585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89af3-9f71-445f-b15a-27ef08725545 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:05.836916 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89af3-9f71-445f-b15a-27ef08725545 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:05.837199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89af3-9f71-445f-b15a-27ef08725545 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:05.847108 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e89af3-9f71-445f-b15a-27ef08725545 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:05.848912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e89af3-9f71-445f-b15a-27ef08725545 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:05.858229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1216/2423] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:43:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:43:07.506849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b73c5b-d4ff-4c02-82fc-476d3988f10d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:07.624515 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b73c5b-d4ff-4c02-82fc-476d3988f10d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:07.632565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:07.634009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:07.635094 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:07.635812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] PATH_INFO: `/v3/users/0b71260ce1664d5789427c2a4f26728b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:07.641655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b71260ce1664d5789427c2a4f26728b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:07.645609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:07.912557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b71260ce1664d5789427c2a4f26728b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:07.997824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b71260ce1664d5789427c2a4f26728b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:08.032649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b71260ce1664d5789427c2a4f26728b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:08.033408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b71260ce1664d5789427c2a4f26728b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:08.045132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b71260ce1664d5789427c2a4f26728b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:08.056810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1208/2424] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:43:07 2022] DELETE /identity/v3/users/0b71260ce1664d5789427c2a4f26728b => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:43:08.062779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c8e5-4e59-43bc-8e60-33380c6820d3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:08.063731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c8e5-4e59-43bc-8e60-33380c6820d3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:08.064263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7c8e5-4e59-43bc-8e60-33380c6820d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:08.118420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-87c7c8e5-4e59-43bc-8e60-33380c6820d3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:08.122676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87c7c8e5-4e59-43bc-8e60-33380c6820d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:08.338562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1217/2425] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:08.356884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:08.358481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:08.480324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17b49-59d6-4587-9aff-1b0541a8ef79 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:08.497042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573de19a-407a-4a98-909d-a9f5e319b64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:08.498057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573de19a-407a-4a98-909d-a9f5e319b64c service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:08.498389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573de19a-407a-4a98-909d-a9f5e319b64c service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:08.498764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573de19a-407a-4a98-909d-a9f5e319b64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:08.511736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573de19a-407a-4a98-909d-a9f5e319b64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:08.513346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573de19a-407a-4a98-909d-a9f5e319b64c service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:08.523719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1209/2426] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:43:09.119208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7c8e5-4e59-43bc-8e60-33380c6820d3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:09.121268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87c7c8e5-4e59-43bc-8e60-33380c6820d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:09.138515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7c8e5-4e59-43bc-8e60-33380c6820d3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:09.166699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:09.168085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:09.168368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:09.171644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] PATH_INFO: `/v3/projects/6d40b17dc23043d2aff58fe4cda3eaa0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:09.184731 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d40b17dc23043d2aff58fe4cda3eaa0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:09.186962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:09.575455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d40b17dc23043d2aff58fe4cda3eaa0', 'request_id': 'req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:09.576700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d40b17dc23043d2aff58fe4cda3eaa0', 'request_id': 'req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:09.583707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d40b17dc23043d2aff58fe4cda3eaa0', 'request_id': 'req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:09.774931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] The token cache is being invalidate because project 6d40b17dc23043d2aff58fe4cda3eaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:43:09.775481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:09.776114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:09.777646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1218/2427] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:43:09 2022] DELETE /identity/v3/projects/6d40b17dc23043d2aff58fe4cda3eaa0 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:43:16.526499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573de19a-407a-4a98-909d-a9f5e319b64c service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:16.535898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573de19a-407a-4a98-909d-a9f5e319b64c service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:16.547508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:16.588089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:16.588089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:16.588089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:16.588440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:16.590240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:16.663804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:16.665284 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:16.678833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1210/2428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:43:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:43:19.771775 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:27.032603 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=43 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:27.418940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:27.422396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:27.447719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:27.450122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:27.489302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6a771-93fa-4da3-a0bf-799ec2fa3ae0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:27.493983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:27.495162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:27.495162 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:27.495390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] PATH_INFO: `/v3/users/87b322a5c52a4eff9cc9b3d2521e7ba6` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:27.496592 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b322a5c52a4eff9cc9b3d2521e7ba6)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:27.498753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:27.557168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e16fa-2f8d-4056-bcc4-8aa8ed8a8f72 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:27.562264 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e17f4-c784-40c3-b694-6715fa16d5ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:27.562923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e17f4-c784-40c3-b694-6715fa16d5ee service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:27.563748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e17f4-c784-40c3-b694-6715fa16d5ee service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:27.564061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e17f4-c784-40c3-b694-6715fa16d5ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:27.565802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-960e17f4-c784-40c3-b694-6715fa16d5ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:27.590512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e17f4-c784-40c3-b694-6715fa16d5ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:27.592449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e17f4-c784-40c3-b694-6715fa16d5ee service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:27.603048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1211/2429] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:43:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:43:27.753309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b322a5c52a4eff9cc9b3d2521e7ba6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:27.760538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b322a5c52a4eff9cc9b3d2521e7ba6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:27.846573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b322a5c52a4eff9cc9b3d2521e7ba6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:27.849653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b322a5c52a4eff9cc9b3d2521e7ba6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:27.862405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b322a5c52a4eff9cc9b3d2521e7ba6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:27.869498 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1219/2430] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:43:27 2022] DELETE /identity/v3/users/87b322a5c52a4eff9cc9b3d2521e7ba6 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:43:27.874108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4fca2-8b23-4107-8e93-4bd1ea4e2eaf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:27.874405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4fca2-8b23-4107-8e93-4bd1ea4e2eaf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:27.878412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4fca2-8b23-4107-8e93-4bd1ea4e2eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:27.893252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f8f4fca2-8b23-4107-8e93-4bd1ea4e2eaf None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:27.894465 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f8f4fca2-8b23-4107-8e93-4bd1ea4e2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:27.956897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1212/2431] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:27.966419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:27.967897 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:28.037889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50f50-8ff3-4367-9594-bd948739856c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:28.041537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2786d-1990-4744-bd6c-be8e9e236da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:28.042448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2786d-1990-4744-bd6c-be8e9e236da0 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:28.042448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2786d-1990-4744-bd6c-be8e9e236da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:28.044854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2786d-1990-4744-bd6c-be8e9e236da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:28.053264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2786d-1990-4744-bd6c-be8e9e236da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:28.054852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2786d-1990-4744-bd6c-be8e9e236da0 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:28.064648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1220/2432] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:43:28.551234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4fca2-8b23-4107-8e93-4bd1ea4e2eaf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:28.551234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f8f4fca2-8b23-4107-8e93-4bd1ea4e2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:28.578586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4fca2-8b23-4107-8e93-4bd1ea4e2eaf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:28.583759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:28.584678 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:28.585083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:28.585360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] PATH_INFO: `/v3/projects/a2e13c8ba960469fb69a65328e70a666` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:28.586529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e13c8ba960469fb69a65328e70a666)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:28.588459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:28.728147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e13c8ba960469fb69a65328e70a666', 'request_id': 'req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:28.746938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e13c8ba960469fb69a65328e70a666', 'request_id': 'req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:28.769360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e13c8ba960469fb69a65328e70a666', 'request_id': 'req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:28.779499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:28.870446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] The token cache is being invalidate because project a2e13c8ba960469fb69a65328e70a666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:43:28.872087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:28.872087 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6a9cf6f-83e7-4b51-8bce-83f554d59c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:28.873085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1213/2433] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:43:28 2022] DELETE /identity/v3/projects/a2e13c8ba960469fb69a65328e70a666 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:43:30.230223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8a7ca-c3bf-4537-851f-4e938aa2374b None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:30.231378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8a7ca-c3bf-4537-851f-4e938aa2374b None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:30.231764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8a7ca-c3bf-4537-851f-4e938aa2374b None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:30.233845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1221/2434] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:43:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:43:30.240193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ca6d-3c7f-4772-9174-b0251ad3c83b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:30.240652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ca6d-3c7f-4772-9174-b0251ad3c83b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:30.240738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432ca6d-3c7f-4772-9174-b0251ad3c83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:30.307426 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e432ca6d-3c7f-4772-9174-b0251ad3c83b None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:30.308686 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e432ca6d-3c7f-4772-9174-b0251ad3c83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:30.395417 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1214/2435] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:30.406776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8a7ca-c3bf-4537-851f-4e938aa2374b None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:30.408525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7df8a7ca-c3bf-4537-851f-4e938aa2374b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:30.435092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:30.467260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8a7ca-c3bf-4537-851f-4e938aa2374b None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:30.470991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459dbb-4b71-45a7-9681-b2d985c84151 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d6317775c343eaa9397254074647f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:30.471651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459dbb-4b71-45a7-9681-b2d985c84151 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:30.471959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459dbb-4b71-45a7-9681-b2d985c84151 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:30.472247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459dbb-4b71-45a7-9681-b2d985c84151 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:30.482672 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63459dbb-4b71-45a7-9681-b2d985c84151 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:30.484169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63459dbb-4b71-45a7-9681-b2d985c84151 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:30.495713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1222/2436] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:43:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:43:30.769629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c28e4-85b9-4eaf-9061-93a422d73a47 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:30.769919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c28e4-85b9-4eaf-9061-93a422d73a47 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:30.770198 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c28e4-85b9-4eaf-9061-93a422d73a47 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:30.771571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1215/2437] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:43:30.776301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4541-ac86-44f3-af2e-f514218e14d5 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:30.776648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4541-ac86-44f3-af2e-f514218e14d5 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:30.776934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4541-ac86-44f3-af2e-f514218e14d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:30.794365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b82a4541-ac86-44f3-af2e-f514218e14d5 None None] MFA Rules not processed for user `1eaffae68edd4031ac771310b7d645cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:30.795588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b82a4541-ac86-44f3-af2e-f514218e14d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:30.847398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1223/2438] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:30.859047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c28e4-85b9-4eaf-9061-93a422d73a47 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:30.861256 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ab1c28e4-85b9-4eaf-9061-93a422d73a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:30.874216 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c28e4-85b9-4eaf-9061-93a422d73a47 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:30.878548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce567e80-34ad-412e-997d-79e9cc5cd7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:30.883524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce567e80-34ad-412e-997d-79e9cc5cd7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:30.883524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce567e80-34ad-412e-997d-79e9cc5cd7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:30.883524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce567e80-34ad-412e-997d-79e9cc5cd7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:30.887537 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce567e80-34ad-412e-997d-79e9cc5cd7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:30.889059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce567e80-34ad-412e-997d-79e9cc5cd7b6 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:30.896930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1216/2439] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:43:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:43:30.979685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5dff-56e5-4322-abd2-b7817a6417aa None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:30.980006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5dff-56e5-4322-abd2-b7817a6417aa None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:30.980288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5dff-56e5-4322-abd2-b7817a6417aa None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:30.981697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1224/2440] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:43:30.987567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2cefe-9e08-4c02-9ae0-740ddcf36c1a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:30.987948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2cefe-9e08-4c02-9ae0-740ddcf36c1a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:30.988299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2cefe-9e08-4c02-9ae0-740ddcf36c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:31.007174 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2cc2cefe-9e08-4c02-9ae0-740ddcf36c1a None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:31.008562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2cc2cefe-9e08-4c02-9ae0-740ddcf36c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:31.018408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1217/2441] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:31.030651 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5dff-56e5-4322-abd2-b7817a6417aa None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:31.040159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5dff-56e5-4322-abd2-b7817a6417aa None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:31.043763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:31.044417 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:31.044699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:31.044972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:31.055589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:31.059304 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:31.067962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1225/2442] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:43:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:43:35.257053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9cc7-2564-48e2-b864-2d88c411575a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:35.257495 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9cc7-2564-48e2-b864-2d88c411575a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:35.257584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9cc7-2564-48e2-b864-2d88c411575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:35.305994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f1aa9cc7-2564-48e2-b864-2d88c411575a None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:35.307209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f1aa9cc7-2564-48e2-b864-2d88c411575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:35.353031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:35.370271 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1218/2443] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:43:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:35.383041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:35.384448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:35.475823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2df52e-36e4-4cc6-9605-b10b8e220b28 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:35.480862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153f7c-28ef-4161-b50f-258bfd4c39a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:35.481502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153f7c-28ef-4161-b50f-258bfd4c39a0 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:35.481785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153f7c-28ef-4161-b50f-258bfd4c39a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:35.482105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153f7c-28ef-4161-b50f-258bfd4c39a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:35.490603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05153f7c-28ef-4161-b50f-258bfd4c39a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:35.492220 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05153f7c-28ef-4161-b50f-258bfd4c39a0 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:35.500091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1226/2444] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:43:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:43:38.346857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fa733-0ee1-4e55-b805-171ac7d7fc64 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:38.347814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fa733-0ee1-4e55-b805-171ac7d7fc64 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:38.348328 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fa733-0ee1-4e55-b805-171ac7d7fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:38.369521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-722fa733-0ee1-4e55-b805-171ac7d7fc64 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:38.370860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-722fa733-0ee1-4e55-b805-171ac7d7fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:38.388592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1219/2445] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:43:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:38.407792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153f7c-28ef-4161-b50f-258bfd4c39a0 service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:38.425784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153f7c-28ef-4161-b50f-258bfd4c39a0 service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:38.425784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5855ac0-1ee9-4b45-a4bb-298c43b56c72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:38.426106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5855ac0-1ee9-4b45-a4bb-298c43b56c72 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:38.427206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5855ac0-1ee9-4b45-a4bb-298c43b56c72 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:38.438409 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5855ac0-1ee9-4b45-a4bb-298c43b56c72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:38.452727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5855ac0-1ee9-4b45-a4bb-298c43b56c72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:38.470945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5855ac0-1ee9-4b45-a4bb-298c43b56c72 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:38.484457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1227/2446] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:43:48.363436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:48.475601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:52.924918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b22d65-6f7a-49ea-9c0a-704369c6e125 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:52.925433 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b22d65-6f7a-49ea-9c0a-704369c6e125 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:52.925523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b22d65-6f7a-49ea-9c0a-704369c6e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:52.942847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-27b22d65-6f7a-49ea-9c0a-704369c6e125 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:52.944043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-27b22d65-6f7a-49ea-9c0a-704369c6e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:52.950989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1220/2447] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jun 15 00:43:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:52.963385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5855ac0-1ee9-4b45-a4bb-298c43b56c72 service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:52.973765 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5855ac0-1ee9-4b45-a4bb-298c43b56c72 service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:52.978735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a1b1d-e713-4972-8e2d-153f5d8f074e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:52.979359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a1b1d-e713-4972-8e2d-153f5d8f074e service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:52.979642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a1b1d-e713-4972-8e2d-153f5d8f074e service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:52.979945 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a1b1d-e713-4972-8e2d-153f5d8f074e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:52.987997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a1b1d-e713-4972-8e2d-153f5d8f074e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:52.989619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a1b1d-e713-4972-8e2d-153f5d8f074e service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:52.997895 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1228/2448] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:43:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:43:55.888989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b22d65-6f7a-49ea-9c0a-704369c6e125 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:55.888989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-27b22d65-6f7a-49ea-9c0a-704369c6e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:55.955979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b22d65-6f7a-49ea-9c0a-704369c6e125 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:55.960405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:55.961260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:55.961543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:55.961821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] PATH_INFO: `/v3/users/b7de51e3989248088b608a5d50400064` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:55.963006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7de51e3989248088b608a5d50400064)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:55.964958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:56.197432 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7de51e3989248088b608a5d50400064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.263442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7de51e3989248088b608a5d50400064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.276231 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7de51e3989248088b608a5d50400064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.276877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7de51e3989248088b608a5d50400064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.284415 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c220d02e-e082-4985-bb89-25409be9f882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7de51e3989248088b608a5d50400064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.290449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1221/2449] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:43:55 2022] DELETE /identity/v3/users/b7de51e3989248088b608a5d50400064 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:43:56.555840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a1b1d-e713-4972-8e2d-153f5d8f074e service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:56.567629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a1b1d-e713-4972-8e2d-153f5d8f074e service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:56.631022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:56.631870 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:56.632178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:56.632452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] PATH_INFO: `/v3/projects/a0645668bf03499f97a2a54cbe75e3fe` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:56.633621 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0645668bf03499f97a2a54cbe75e3fe)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:56.635839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:56.731347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0645668bf03499f97a2a54cbe75e3fe', 'request_id': 'req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.736934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0645668bf03499f97a2a54cbe75e3fe', 'request_id': 'req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.743105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0645668bf03499f97a2a54cbe75e3fe', 'request_id': 'req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.817780 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] The token cache is being invalidate because project a0645668bf03499f97a2a54cbe75e3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:43:56.818066 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.818675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:43:56.820427 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1229/2450] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:43:56 2022] DELETE /identity/v3/projects/a0645668bf03499f97a2a54cbe75e3fe => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:44:03.278721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726b31-716d-4252-8642-4e2efeef925b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:03.279168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726b31-716d-4252-8642-4e2efeef925b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:03.279280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726b31-716d-4252-8642-4e2efeef925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:03.296093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-08726b31-716d-4252-8642-4e2efeef925b None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:03.297282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-08726b31-716d-4252-8642-4e2efeef925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:03.350823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1222/2451] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jun 15 00:44:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:03.362640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:03.364039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:03.432188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd4d6c-ceb4-4c3b-8114-2451f93376d6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:03.437281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c34609-f549-45fd-8136-3b7aaed94f72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:03.438408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34609-f549-45fd-8136-3b7aaed94f72 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:03.438687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34609-f549-45fd-8136-3b7aaed94f72 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:03.438961 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34609-f549-45fd-8136-3b7aaed94f72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:03.446988 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c34609-f549-45fd-8136-3b7aaed94f72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:03.448596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c34609-f549-45fd-8136-3b7aaed94f72 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:03.457436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1230/2452] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:44:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:44:13.344324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:13.454728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:34.316781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a8c1-d53f-4631-a07a-a0a7246d95e6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:34.317320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a8c1-d53f-4631-a07a-a0a7246d95e6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:34.317320 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54a8c1-d53f-4631-a07a-a0a7246d95e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:34.335156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ea54a8c1-d53f-4631-a07a-a0a7246d95e6 None None] MFA Rules not processed for user `4989693e66c44d6a8e5f8543f1b9c516`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:34.336372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ea54a8c1-d53f-4631-a07a-a0a7246d95e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:34.388474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1223/2453] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:44:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:44.381874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:51.373172 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a3500-f93f-4f85-85c5-07763ed60301 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:51.373652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a3500-f93f-4f85-85c5-07763ed60301 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:51.373743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a3500-f93f-4f85-85c5-07763ed60301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:51.392287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-732a3500-f93f-4f85-85c5-07763ed60301 None None] MFA Rules not processed for user `d9a0bbb1f50c42acb50dac254a653da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:51.393469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-732a3500-f93f-4f85-85c5-07763ed60301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:51.466539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1231/2454] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:44:51.593422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251e43-6027-4710-b27f-bc94d4d42e23 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:51.593918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251e43-6027-4710-b27f-bc94d4d42e23 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:51.594014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251e43-6027-4710-b27f-bc94d4d42e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:51.612081 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-35251e43-6027-4710-b27f-bc94d4d42e23 None None] MFA Rules not processed for user `2ff9f53decbc44ce9166f6c841e8ea02`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:51.613296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-35251e43-6027-4710-b27f-bc94d4d42e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:51.672098 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1224/2455] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:01.456796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=25 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:01.662180 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:17.309646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a3500-f93f-4f85-85c5-07763ed60301 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.311043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-732a3500-f93f-4f85-85c5-07763ed60301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:17.388034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a3500-f93f-4f85-85c5-07763ed60301 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.391995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.392627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.392902 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.393177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.394916 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:17.463605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.465060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.475747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1232/2456] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:20.271393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35251e43-6027-4710-b27f-bc94d4d42e23 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:20.272887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-35251e43-6027-4710-b27f-bc94d4d42e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:20.327942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35251e43-6027-4710-b27f-bc94d4d42e23 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:20.332195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:20.332834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:20.333125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:20.333395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:20.335135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:20.349022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:20.350443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:20.361466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1225/2457] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:26.463758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.474956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef22e6-daf6-473b-b229-df232d1399f1 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.478552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.479200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.479482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.479756 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.481729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:26.494600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.496120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.505883 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1233/2458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:30.356546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=26 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:36.501617 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=69 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:38.710245 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:38.718713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba699ca6-2e9e-4282-b038-e48d2da0af35 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:38.722498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:38.723133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:38.723410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:38.723681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:38.725511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:38.739076 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:38.740575 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:38.749408 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1226/2459] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:42.805256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:42.806638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:42.817722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61cd94-4985-490c-abe9-e97fea3fd6f5 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:42.821504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6801061-9648-460c-b0e6-db57d9e6cbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:42.822140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801061-9648-460c-b0e6-db57d9e6cbee service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:42.822425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801061-9648-460c-b0e6-db57d9e6cbee service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:42.822706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801061-9648-460c-b0e6-db57d9e6cbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:42.824563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c6801061-9648-460c-b0e6-db57d9e6cbee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:42.843632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:42.852768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fac23-b715-46dd-b7f8-59e86c5bbcbe service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:42.857186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08630992-17a2-4ad9-a2d0-4eb2fe5719af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:42.857813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08630992-17a2-4ad9-a2d0-4eb2fe5719af service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:42.858095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08630992-17a2-4ad9-a2d0-4eb2fe5719af service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:42.858373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08630992-17a2-4ad9-a2d0-4eb2fe5719af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:42.860196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-08630992-17a2-4ad9-a2d0-4eb2fe5719af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:42.870551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08630992-17a2-4ad9-a2d0-4eb2fe5719af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:42.871986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08630992-17a2-4ad9-a2d0-4eb2fe5719af service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:42.880571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1227/2460] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:45:42.892820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6801061-9648-460c-b0e6-db57d9e6cbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:42.894271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6801061-9648-460c-b0e6-db57d9e6cbee service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:42.904079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1234/2461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:43.210112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53b1b-1504-42e7-8c22-058f444864db None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.210666 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53b1b-1504-42e7-8c22-058f444864db None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.211013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe53b1b-1504-42e7-8c22-058f444864db None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.212404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1228/2462] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:45:43.219242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32049f5-ec00-466f-ba5f-2b58bbcd4430 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.220419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32049f5-ec00-466f-ba5f-2b58bbcd4430 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.220419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32049f5-ec00-466f-ba5f-2b58bbcd4430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.239989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b32049f5-ec00-466f-ba5f-2b58bbcd4430 None None] MFA Rules not processed for user `1eaffae68edd4031ac771310b7d645cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:43.241548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b32049f5-ec00-466f-ba5f-2b58bbcd4430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:43.249413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1235/2463] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:43.277214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe53b1b-1504-42e7-8c22-058f444864db None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.289937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe53b1b-1504-42e7-8c22-058f444864db None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.293708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51cbae-c5a6-457c-8087-adec21dcd771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.294557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cbae-c5a6-457c-8087-adec21dcd771 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.294868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cbae-c5a6-457c-8087-adec21dcd771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.295326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cbae-c5a6-457c-8087-adec21dcd771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.304213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51cbae-c5a6-457c-8087-adec21dcd771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.305629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51cbae-c5a6-457c-8087-adec21dcd771 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.314280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1229/2464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:43.442395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644ada-a300-4a8d-a951-f41b00d51f5f None None] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.442679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644ada-a300-4a8d-a951-f41b00d51f5f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.442956 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f644ada-a300-4a8d-a951-f41b00d51f5f None None] PATH_INFO: `/` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.444519 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1236/2465] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jun 15 00:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:45:43.455183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68729-171e-477a-81f6-9cdfa17c8fd0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.455183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68729-171e-477a-81f6-9cdfa17c8fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.455183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68729-171e-477a-81f6-9cdfa17c8fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.471982 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b8f68729-171e-477a-81f6-9cdfa17c8fd0 None None] MFA Rules not processed for user `ad41d031778c4e8ebc8c176c3670f4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:43.473565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b8f68729-171e-477a-81f6-9cdfa17c8fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:43.483773 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1230/2466] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:43.514420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f644ada-a300-4a8d-a951-f41b00d51f5f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.526270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f644ada-a300-4a8d-a951-f41b00d51f5f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.531217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.531941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.532219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.532495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.543453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.545257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.557401 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1237/2467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:43.651657 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f68729-171e-477a-81f6-9cdfa17c8fd0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.653190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b8f68729-171e-477a-81f6-9cdfa17c8fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:43.721168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f68729-171e-477a-81f6-9cdfa17c8fd0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.726296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.726942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.727219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.727492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.735797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:43.747737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.749524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.759969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1231/2468] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:44.032310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.034935 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:44.056692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f770133-8a31-4990-bd15-5c4a8cf4aa59 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.062635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.063863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.064208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.064485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.066293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:44.084981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.087051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.097404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1238/2469] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:45:45.409145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:45.421646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7260e8-7a95-47d6-951f-54000015f0a9 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:45.427660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:45.428324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:45.428602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:45.428873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:45.430680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:45.441547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:45.443140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:45.456211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1232/2470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:46.978917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:46.982434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:46.995216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e89ea-c927-4dfa-b7b0-f3fe019ee3ca service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:46.999806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:47.000912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:47.001189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:47.005308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] PATH_INFO: `/v3/users/4989693e66c44d6a8e5f8543f1b9c516` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:47.005308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4989693e66c44d6a8e5f8543f1b9c516)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:47.005308 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:47.204167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4989693e66c44d6a8e5f8543f1b9c516'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.212275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4989693e66c44d6a8e5f8543f1b9c516'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.268404 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4989693e66c44d6a8e5f8543f1b9c516'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.269061 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4989693e66c44d6a8e5f8543f1b9c516'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.283293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-54308052-a33b-4091-8029-6cf196df0564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4989693e66c44d6a8e5f8543f1b9c516'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.290080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1239/2471] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:46 2022] DELETE /identity/v3/users/4989693e66c44d6a8e5f8543f1b9c516 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:47.523470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:47.535053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755900e-5584-4286-b50a-392b2b3e5071 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:47.605137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:47.605988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:47.606279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:47.606538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] PATH_INFO: `/v3/projects/bcdef82f627f42b29f6da17f6bad6dd4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:47.607705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdef82f627f42b29f6da17f6bad6dd4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:47.609683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:47.725814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:47.741321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdef82f627f42b29f6da17f6bad6dd4', 'request_id': 'req-a7cc5b15-8401-4b82-a123-666b874a3689'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.754880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdef82f627f42b29f6da17f6bad6dd4', 'request_id': 'req-a7cc5b15-8401-4b82-a123-666b874a3689'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.761163 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdef82f627f42b29f6da17f6bad6dd4', 'request_id': 'req-a7cc5b15-8401-4b82-a123-666b874a3689'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.836822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] The token cache is being invalidate because project bcdef82f627f42b29f6da17f6bad6dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:47.837121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.837804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a7cc5b15-8401-4b82-a123-666b874a3689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:47.839483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1233/2472] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:47 2022] DELETE /identity/v3/projects/bcdef82f627f42b29f6da17f6bad6dd4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:47.844567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406c24-e233-4ed4-a758-df273f9ff3c0 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:47.845101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406c24-e233-4ed4-a758-df273f9ff3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:47.845377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406c24-e233-4ed4-a758-df273f9ff3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:47.863055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-43406c24-e233-4ed4-a758-df273f9ff3c0 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:47.864275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-43406c24-e233-4ed4-a758-df273f9ff3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:47.893830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:47.945209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1240/2473] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:47.954407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323cbc-a2ff-4b7e-aa23-1be4711d1a12 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:47.955676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323cbc-a2ff-4b7e-aa23-1be4711d1a12 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:47.956177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323cbc-a2ff-4b7e-aa23-1be4711d1a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:47.977932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-53323cbc-a2ff-4b7e-aa23-1be4711d1a12 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:47.979741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53323cbc-a2ff-4b7e-aa23-1be4711d1a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:47.990223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1234/2474] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:47.994606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43406c24-e233-4ed4-a758-df273f9ff3c0 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.005932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43406c24-e233-4ed4-a758-df273f9ff3c0 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.010892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.011550 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.011834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.012151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.013135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:48.013446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.015041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:48.027129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1241/2475] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:48.035747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53323cbc-a2ff-4b7e-aa23-1be4711d1a12 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.040999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53323cbc-a2ff-4b7e-aa23-1be4711d1a12 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.045859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0741ee-30a7-4f57-8998-7d6572f4ea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.046507 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0741ee-30a7-4f57-8998-7d6572f4ea3f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.046787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0741ee-30a7-4f57-8998-7d6572f4ea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.050762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0741ee-30a7-4f57-8998-7d6572f4ea3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.050762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0741ee-30a7-4f57-8998-7d6572f4ea3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.050762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0741ee-30a7-4f57-8998-7d6572f4ea3f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:48.137641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1235/2476] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:48 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:48.141774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.155047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e04a-e9c9-460a-bbb6-4e156199d219 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.216044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2234-33ab-49ba-a4c8-f8139526d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.216714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2234-33ab-49ba-a4c8-f8139526d55d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.216998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2234-33ab-49ba-a4c8-f8139526d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.217274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2234-33ab-49ba-a4c8-f8139526d55d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.217978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e2234-33ab-49ba-a4c8-f8139526d55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.220493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e2234-33ab-49ba-a4c8-f8139526d55d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:48.307637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1242/2477] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:48 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:45:48.309130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0741ee-30a7-4f57-8998-7d6572f4ea3f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.319986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0741ee-30a7-4f57-8998-7d6572f4ea3f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.324834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3faac1-b10e-4809-99c1-4a10263578dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.325511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3faac1-b10e-4809-99c1-4a10263578dc admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.325791 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3faac1-b10e-4809-99c1-4a10263578dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.326064 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3faac1-b10e-4809-99c1-4a10263578dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.326823 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3faac1-b10e-4809-99c1-4a10263578dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.328499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3faac1-b10e-4809-99c1-4a10263578dc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:48.339794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1236/2478] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:48.344618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2234-33ab-49ba-a4c8-f8139526d55d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.355271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2234-33ab-49ba-a4c8-f8139526d55d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.360805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963ac44-e8c5-4cec-bd9c-3da87a6f9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.361483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963ac44-e8c5-4cec-bd9c-3da87a6f9686 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.361769 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963ac44-e8c5-4cec-bd9c-3da87a6f9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.362043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963ac44-e8c5-4cec-bd9c-3da87a6f9686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.362811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963ac44-e8c5-4cec-bd9c-3da87a6f9686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.364528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963ac44-e8c5-4cec-bd9c-3da87a6f9686 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:48.375542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1243/2479] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:48.379886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3faac1-b10e-4809-99c1-4a10263578dc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.390601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3faac1-b10e-4809-99c1-4a10263578dc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.395309 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cebb88-6039-4fde-a298-025f9b14ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.396258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cebb88-6039-4fde-a298-025f9b14ddd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.396540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cebb88-6039-4fde-a298-025f9b14ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.396814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cebb88-6039-4fde-a298-025f9b14ddd1 admin admin] PATH_INFO: `/v3/projects/7e416ca5bddf41409400aedbe71e8bf2/users/3e41df1f825c4a4db2bc47b098f9289c/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.413119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cebb88-6039-4fde-a298-025f9b14ddd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e416ca5bddf41409400aedbe71e8bf2, user_id=3e41df1f825c4a4db2bc47b098f9289c, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.415776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cebb88-6039-4fde-a298-025f9b14ddd1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:48.492650 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1237/2480] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:48 2022] PUT /identity/v3/projects/7e416ca5bddf41409400aedbe71e8bf2/users/3e41df1f825c4a4db2bc47b098f9289c/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:48.502862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d6447-2cca-4936-82f4-661efb343a73 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.503091 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d6447-2cca-4936-82f4-661efb343a73 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.503364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d6447-2cca-4936-82f4-661efb343a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.532815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b84d6447-2cca-4936-82f4-661efb343a73 None None] MFA Rules not processed for user `3e41df1f825c4a4db2bc47b098f9289c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:48.534036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b84d6447-2cca-4936-82f4-661efb343a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:48.598633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1244/2481] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:45:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:48.603201 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cebb88-6039-4fde-a298-025f9b14ddd1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.664840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cebb88-6039-4fde-a298-025f9b14ddd1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.669661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267142-6706-4a57-9146-7a6f9df86496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.670311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267142-6706-4a57-9146-7a6f9df86496 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.670597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267142-6706-4a57-9146-7a6f9df86496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.670875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3267142-6706-4a57-9146-7a6f9df86496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.671564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3267142-6706-4a57-9146-7a6f9df86496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.673534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3267142-6706-4a57-9146-7a6f9df86496 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:48.790302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1238/2482] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:48 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:48.794508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d6447-2cca-4936-82f4-661efb343a73 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.805168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d6447-2cca-4936-82f4-661efb343a73 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.831817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:48.861868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5289-7213-4ffb-9f88-fb748641fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.862577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5289-7213-4ffb-9f88-fb748641fb98 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.862860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5289-7213-4ffb-9f88-fb748641fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.863135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5289-7213-4ffb-9f88-fb748641fb98 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.863832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5289-7213-4ffb-9f88-fb748641fb98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.865781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5289-7213-4ffb-9f88-fb748641fb98 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:48.975946 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1245/2483] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:48 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:48.979754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267142-6706-4a57-9146-7a6f9df86496 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:48.990212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3267142-6706-4a57-9146-7a6f9df86496 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:48.996108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c125a-8fc1-41a4-88b6-c30d9893e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:48.996879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c125a-8fc1-41a4-88b6-c30d9893e027 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:48.997167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c125a-8fc1-41a4-88b6-c30d9893e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:48.997444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c125a-8fc1-41a4-88b6-c30d9893e027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:48.998172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c125a-8fc1-41a4-88b6-c30d9893e027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:48.999759 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c125a-8fc1-41a4-88b6-c30d9893e027 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:49.011880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1239/2484] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:49.016492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5289-7213-4ffb-9f88-fb748641fb98 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:49.026729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5289-7213-4ffb-9f88-fb748641fb98 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:49.031329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78da76-bf0d-47d3-9930-659bb1406f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:49.036138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78da76-bf0d-47d3-9930-659bb1406f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:49.036138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78da76-bf0d-47d3-9930-659bb1406f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:49.036138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78da76-bf0d-47d3-9930-659bb1406f56 admin admin] PATH_INFO: `/v3/projects/cb10be7ea9134518974a4bd5d4b9cf49/users/74cae54b25684c58bfa757f73ffb9dc9/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:49.048805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78da76-bf0d-47d3-9930-659bb1406f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb10be7ea9134518974a4bd5d4b9cf49, user_id=74cae54b25684c58bfa757f73ffb9dc9, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:49.051667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78da76-bf0d-47d3-9930-659bb1406f56 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:49.102866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1246/2485] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:49 2022] PUT /identity/v3/projects/cb10be7ea9134518974a4bd5d4b9cf49/users/74cae54b25684c58bfa757f73ffb9dc9/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:49.106589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c125a-8fc1-41a4-88b6-c30d9893e027 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:49.116605 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c125a-8fc1-41a4-88b6-c30d9893e027 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:49.146192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:49.173531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952c99-8383-4b1b-af71-1b0e2335b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:49.174199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952c99-8383-4b1b-af71-1b0e2335b596 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:49.174480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952c99-8383-4b1b-af71-1b0e2335b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:49.174758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952c99-8383-4b1b-af71-1b0e2335b596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:49.175479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952c99-8383-4b1b-af71-1b0e2335b596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:49.177100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d952c99-8383-4b1b-af71-1b0e2335b596 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:49.186800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1240/2486] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:49.191452 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78da76-bf0d-47d3-9930-659bb1406f56 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:49.202029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78da76-bf0d-47d3-9930-659bb1406f56 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:49.207440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:49.208426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:49.208705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:49.208981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] PATH_INFO: `/v3/projects/cb10be7ea9134518974a4bd5d4b9cf49/users/74cae54b25684c58bfa757f73ffb9dc9/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:49.211001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb10be7ea9134518974a4bd5d4b9cf49, user_id=74cae54b25684c58bfa757f73ffb9dc9, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:49.213723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:49.224533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1247/2487] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:49 2022] PUT /identity/v3/projects/cb10be7ea9134518974a4bd5d4b9cf49/users/74cae54b25684c58bfa757f73ffb9dc9/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:49.235581 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e101-3f02-455e-9e64-ba380f5db0ea None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:49.235864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e101-3f02-455e-9e64-ba380f5db0ea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:49.236179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e101-3f02-455e-9e64-ba380f5db0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:49.263732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fc73e101-3f02-455e-9e64-ba380f5db0ea None None] MFA Rules not processed for user `74cae54b25684c58bfa757f73ffb9dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:49.266386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fc73e101-3f02-455e-9e64-ba380f5db0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:49.331257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1241/2488] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:45:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:49.342273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:49.344005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:49.399111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647724-1c53-4f7f-b4dd-2f5651ba46a5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:49.402606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd29eb-2d0e-4dfa-aab9-2290af4c50ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:49.403223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd29eb-2d0e-4dfa-aab9-2290af4c50ef service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:49.403500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd29eb-2d0e-4dfa-aab9-2290af4c50ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:49.403772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd29eb-2d0e-4dfa-aab9-2290af4c50ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:49.412770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd29eb-2d0e-4dfa-aab9-2290af4c50ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:49.414229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd29eb-2d0e-4dfa-aab9-2290af4c50ef service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:49.424266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1248/2489] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:49.647737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e101-3f02-455e-9e64-ba380f5db0ea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:49.657866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e101-3f02-455e-9e64-ba380f5db0ea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:49.661439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:49.662080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:49.662364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:49.662641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:49.723473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:49.724947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:49.735287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1242/2490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:59.419501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=57,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:59.735407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=77 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:01.423707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5c70-c24e-4bbd-aea5-275c966be970 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:01.424254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5c70-c24e-4bbd-aea5-275c966be970 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:01.424653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5c70-c24e-4bbd-aea5-275c966be970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:01.445798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0b2c5c70-c24e-4bbd-aea5-275c966be970 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:01.447260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0b2c5c70-c24e-4bbd-aea5-275c966be970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:01.513243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1249/2491] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:46:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:01.679186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:01.679662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c5c70-c24e-4bbd-aea5-275c966be970 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:01.681547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0b2c5c70-c24e-4bbd-aea5-275c966be970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:01.687036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:01.786614 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c5c70-c24e-4bbd-aea5-275c966be970 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:01.793273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:01.795019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:01.795019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:01.795019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:01.798000 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:01.810109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac23268-907a-4ccc-8476-06196b359476 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:01.811872 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:01.813992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:01.815407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdff35-6446-4645-86b6-f274f9488dca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:01.816173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdff35-6446-4645-86b6-f274f9488dca service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:01.820182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdff35-6446-4645-86b6-f274f9488dca service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:01.821335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdff35-6446-4645-86b6-f274f9488dca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:01.830033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1250/2492] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:46:01.833477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdff35-6446-4645-86b6-f274f9488dca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:01.835166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdff35-6446-4645-86b6-f274f9488dca service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:01.855431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1243/2493] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:46:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 00:46:02.037664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:02.182247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb97f60-533d-40d8-89c9-8b596d2fa2f4 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:02.196540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:02.197873 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:02.200001 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:02.204337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] PATH_INFO: `/v3/users/3e41df1f825c4a4db2bc47b098f9289c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:02.208803 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e41df1f825c4a4db2bc47b098f9289c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:02.211337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:02.402807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:02.423966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e41df1f825c4a4db2bc47b098f9289c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:02.436572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e41df1f825c4a4db2bc47b098f9289c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:02.520303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e41df1f825c4a4db2bc47b098f9289c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:02.521117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e41df1f825c4a4db2bc47b098f9289c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:02.546607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e41df1f825c4a4db2bc47b098f9289c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:02.561109 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1251/2494] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:46:02 2022] DELETE /identity/v3/users/3e41df1f825c4a4db2bc47b098f9289c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:02.565593 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ec43-2606-41c1-8d71-86452ae7ffea None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:02.566086 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ec43-2606-41c1-8d71-86452ae7ffea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:02.566369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ec43-2606-41c1-8d71-86452ae7ffea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:02.587285 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e969ec43-2606-41c1-8d71-86452ae7ffea None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:02.588653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e969ec43-2606-41c1-8d71-86452ae7ffea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:02.664355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1244/2495] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:02.674632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:02.677390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:02.751568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3ac89-8010-4b2d-93ce-846bbf56aed7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:02.756286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f50e07-0f3c-4b29-9e68-78050e0c799d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:02.756842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f50e07-0f3c-4b29-9e68-78050e0c799d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:02.756842 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f50e07-0f3c-4b29-9e68-78050e0c799d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:02.757148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f50e07-0f3c-4b29-9e68-78050e0c799d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:02.775059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f50e07-0f3c-4b29-9e68-78050e0c799d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:02.776692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f50e07-0f3c-4b29-9e68-78050e0c799d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:02.787397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1252/2496] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:03.203344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ec43-2606-41c1-8d71-86452ae7ffea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:03.205483 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e969ec43-2606-41c1-8d71-86452ae7ffea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:03.231205 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ec43-2606-41c1-8d71-86452ae7ffea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:03.244258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:03.245272 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:03.245557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:03.245833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] PATH_INFO: `/v3/projects/7e416ca5bddf41409400aedbe71e8bf2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:03.253329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e416ca5bddf41409400aedbe71e8bf2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:03.255641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:03.377234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e416ca5bddf41409400aedbe71e8bf2', 'request_id': 'req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.386608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e416ca5bddf41409400aedbe71e8bf2', 'request_id': 'req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.395345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e416ca5bddf41409400aedbe71e8bf2', 'request_id': 'req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.452994 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] The token cache is being invalidate because project 7e416ca5bddf41409400aedbe71e8bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:46:03.453532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.456438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.461342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1245/2497] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:46:03 2022] DELETE /identity/v3/projects/7e416ca5bddf41409400aedbe71e8bf2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:03.465658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f50e07-0f3c-4b29-9e68-78050e0c799d service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:03.477094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f50e07-0f3c-4b29-9e68-78050e0c799d service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:03.542192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:03.543251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:03.543898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:03.544407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] PATH_INFO: `/v3/users/74cae54b25684c58bfa757f73ffb9dc9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:03.545851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74cae54b25684c58bfa757f73ffb9dc9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:03.548072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:03.717049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74cae54b25684c58bfa757f73ffb9dc9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.727716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:03.737314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74cae54b25684c58bfa757f73ffb9dc9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.806137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74cae54b25684c58bfa757f73ffb9dc9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.806823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74cae54b25684c58bfa757f73ffb9dc9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.827806 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ded20c32-ee0c-45fd-8e3e-b8319dcb1261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74cae54b25684c58bfa757f73ffb9dc9'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:03.839527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1253/2498] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:46:03 2022] DELETE /identity/v3/users/74cae54b25684c58bfa757f73ffb9dc9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:46:04.319624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:04.321214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:04.335348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4715-5a52-41c6-bfa0-f90fc4a88d70 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:04.350631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:04.418536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:04.419714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:04.420213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:04.420706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] PATH_INFO: `/v3/projects/cb10be7ea9134518974a4bd5d4b9cf49` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:04.422140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb10be7ea9134518974a4bd5d4b9cf49)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:04.424298 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:04.531447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb10be7ea9134518974a4bd5d4b9cf49', 'request_id': 'req-dd43e4be-ccea-4fde-aec6-1647d7c0182c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:04.539073 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb10be7ea9134518974a4bd5d4b9cf49', 'request_id': 'req-dd43e4be-ccea-4fde-aec6-1647d7c0182c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:04.546427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb10be7ea9134518974a4bd5d4b9cf49', 'request_id': 'req-dd43e4be-ccea-4fde-aec6-1647d7c0182c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:04.651342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] The token cache is being invalidate because project cb10be7ea9134518974a4bd5d4b9cf49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:46:04.651741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:04.652840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dd43e4be-ccea-4fde-aec6-1647d7c0182c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:04.655702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1246/2499] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:46:04 2022] DELETE /identity/v3/projects/cb10be7ea9134518974a4bd5d4b9cf49 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:04.659615 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e485bd6-4f7c-4519-9786-781f376d6624 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:04.660145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e485bd6-4f7c-4519-9786-781f376d6624 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:04.660342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e485bd6-4f7c-4519-9786-781f376d6624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:04.679443 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3e485bd6-4f7c-4519-9786-781f376d6624 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:04.680700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3e485bd6-4f7c-4519-9786-781f376d6624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:04.747745 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1254/2500] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:46:04.756564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bff2c9-5187-4166-b1dd-c1b10afda4a3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:04.756884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bff2c9-5187-4166-b1dd-c1b10afda4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:04.757130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bff2c9-5187-4166-b1dd-c1b10afda4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:04.777158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c6bff2c9-5187-4166-b1dd-c1b10afda4a3 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:04.778485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c6bff2c9-5187-4166-b1dd-c1b10afda4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:04.787413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1247/2501] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:04.791824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e485bd6-4f7c-4519-9786-781f376d6624 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:04.802792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e485bd6-4f7c-4519-9786-781f376d6624 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:04.807901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:04.808711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:04.809068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:04.809441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:04.810268 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:46:04.810652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:04.812436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:04.833028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1255/2502] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:46:04.837470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bff2c9-5187-4166-b1dd-c1b10afda4a3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:04.847812 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bff2c9-5187-4166-b1dd-c1b10afda4a3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:04.852410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8521b-29fc-4ba4-b74b-0c0d11835e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:04.853055 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8521b-29fc-4ba4-b74b-0c0d11835e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:04.853334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8521b-29fc-4ba4-b74b-0c0d11835e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:04.853610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8521b-29fc-4ba4-b74b-0c0d11835e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:04.854292 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8521b-29fc-4ba4-b74b-0c0d11835e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:04.856204 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8521b-29fc-4ba4-b74b-0c0d11835e24 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:05.173825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1248/2503] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:46:04 2022] POST /identity/v3/projects => generated 377 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:46:05.178053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:05.188817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6008-91b2-496d-b978-abf628897b03 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:05.245918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab863f-21ff-45f6-b31d-e2ed68a173f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:05.246589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab863f-21ff-45f6-b31d-e2ed68a173f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:05.246876 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab863f-21ff-45f6-b31d-e2ed68a173f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:05.247153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab863f-21ff-45f6-b31d-e2ed68a173f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:05.247841 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab863f-21ff-45f6-b31d-e2ed68a173f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:05.249818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab863f-21ff-45f6-b31d-e2ed68a173f3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:05.316376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1256/2504] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:46:05 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:05.320601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8521b-29fc-4ba4-b74b-0c0d11835e24 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:05.331428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8521b-29fc-4ba4-b74b-0c0d11835e24 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:05.336726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad812b-8fc0-4e82-bcd8-070c3d16c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:05.337649 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad812b-8fc0-4e82-bcd8-070c3d16c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:05.338146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad812b-8fc0-4e82-bcd8-070c3d16c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:05.338630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad812b-8fc0-4e82-bcd8-070c3d16c9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:05.339455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad812b-8fc0-4e82-bcd8-070c3d16c9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:05.344184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad812b-8fc0-4e82-bcd8-070c3d16c9ee admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:05.359267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1249/2505] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:05.360575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab863f-21ff-45f6-b31d-e2ed68a173f3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:05.371114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab863f-21ff-45f6-b31d-e2ed68a173f3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:05.375931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c94c0-64aa-4ee2-a352-fd18dc0b086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:05.378740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c94c0-64aa-4ee2-a352-fd18dc0b086f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:05.378740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c94c0-64aa-4ee2-a352-fd18dc0b086f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:05.378740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c94c0-64aa-4ee2-a352-fd18dc0b086f admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:05.378740 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c94c0-64aa-4ee2-a352-fd18dc0b086f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:05.379835 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c94c0-64aa-4ee2-a352-fd18dc0b086f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:05.391943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1257/2506] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:05.395984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad812b-8fc0-4e82-bcd8-070c3d16c9ee admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:05.408202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad812b-8fc0-4e82-bcd8-070c3d16c9ee admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:05.413751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f6099-8821-41b2-981b-7bd1cfd79e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:05.414915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6099-8821-41b2-981b-7bd1cfd79e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:05.415374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6099-8821-41b2-981b-7bd1cfd79e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:05.415797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6099-8821-41b2-981b-7bd1cfd79e21 admin admin] PATH_INFO: `/v3/projects/b7a2b86ec49e4cdd9cda7296dbca8642/users/4892dc432e36494497a880f669e37929/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:05.447722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f6099-8821-41b2-981b-7bd1cfd79e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a2b86ec49e4cdd9cda7296dbca8642, user_id=4892dc432e36494497a880f669e37929, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:05.452269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f6099-8821-41b2-981b-7bd1cfd79e21 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:05.549571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1250/2507] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:46:05 2022] PUT /identity/v3/projects/b7a2b86ec49e4cdd9cda7296dbca8642/users/4892dc432e36494497a880f669e37929/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:05.551934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb00f-93db-43e8-bced-81960b9746a8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:05.552264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb00f-93db-43e8-bced-81960b9746a8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:05.552594 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eb00f-93db-43e8-bced-81960b9746a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:05.586923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c68eb00f-93db-43e8-bced-81960b9746a8 None None] MFA Rules not processed for user `4892dc432e36494497a880f669e37929`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:05.588187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c68eb00f-93db-43e8-bced-81960b9746a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:05.617860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:05.667809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1258/2508] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:05.673265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f6099-8821-41b2-981b-7bd1cfd79e21 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:05.722481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:05.748980 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f6099-8821-41b2-981b-7bd1cfd79e21 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:05.753944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74ea83-99e0-497c-b332-1eb7e8114730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:05.754727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ea83-99e0-497c-b332-1eb7e8114730 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:05.755110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ea83-99e0-497c-b332-1eb7e8114730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:05.755513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ea83-99e0-497c-b332-1eb7e8114730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:05.756327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74ea83-99e0-497c-b332-1eb7e8114730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:05.758475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74ea83-99e0-497c-b332-1eb7e8114730 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:05.865736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1251/2509] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:46:05 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:05.866938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eb00f-93db-43e8-bced-81960b9746a8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:05.879641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eb00f-93db-43e8-bced-81960b9746a8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:05.949015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c78d7-37e8-4a0f-93f0-618ab3356359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:05.949688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c78d7-37e8-4a0f-93f0-618ab3356359 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:05.949971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c78d7-37e8-4a0f-93f0-618ab3356359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:05.950276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c78d7-37e8-4a0f-93f0-618ab3356359 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:05.950993 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c78d7-37e8-4a0f-93f0-618ab3356359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:05.952965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c78d7-37e8-4a0f-93f0-618ab3356359 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:06.027381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1259/2510] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:46:05 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:06.031881 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74ea83-99e0-497c-b332-1eb7e8114730 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:06.044042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74ea83-99e0-497c-b332-1eb7e8114730 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:06.050485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f8c29-6dc0-4bd4-89ec-487636273ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:06.051304 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f8c29-6dc0-4bd4-89ec-487636273ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:06.051672 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f8c29-6dc0-4bd4-89ec-487636273ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:06.052026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f8c29-6dc0-4bd4-89ec-487636273ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:06.052829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f8c29-6dc0-4bd4-89ec-487636273ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:06.054500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f8c29-6dc0-4bd4-89ec-487636273ee6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:06.066805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1252/2511] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:06.072142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c78d7-37e8-4a0f-93f0-618ab3356359 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:06.083533 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c78d7-37e8-4a0f-93f0-618ab3356359 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:06.089042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c8f9-ae94-4a27-9e0a-4f9bbcd2d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:06.090582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c8f9-ae94-4a27-9e0a-4f9bbcd2d1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:06.091159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c8f9-ae94-4a27-9e0a-4f9bbcd2d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:06.091480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c8f9-ae94-4a27-9e0a-4f9bbcd2d1fe admin admin] PATH_INFO: `/v3/projects/094589c070b84a279227bddc45e1de6f/users/6aee5302a91b4d509309e67649c9f385/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:06.110235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792c8f9-ae94-4a27-9e0a-4f9bbcd2d1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=094589c070b84a279227bddc45e1de6f, user_id=6aee5302a91b4d509309e67649c9f385, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:06.113708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792c8f9-ae94-4a27-9e0a-4f9bbcd2d1fe admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:06.190211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1260/2512] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:46:06 2022] PUT /identity/v3/projects/094589c070b84a279227bddc45e1de6f/users/6aee5302a91b4d509309e67649c9f385/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:46:06.195156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f8c29-6dc0-4bd4-89ec-487636273ee6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:06.205661 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f8c29-6dc0-4bd4-89ec-487636273ee6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:06.282070 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c9fef-e060-43dd-a7ba-e6b490d59899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:06.283002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9fef-e060-43dd-a7ba-e6b490d59899 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:06.283002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9fef-e060-43dd-a7ba-e6b490d59899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:06.283283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c9fef-e060-43dd-a7ba-e6b490d59899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:06.284068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c9fef-e060-43dd-a7ba-e6b490d59899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:06.285673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c9fef-e060-43dd-a7ba-e6b490d59899 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:06.297768 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1253/2513] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:06.303020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c8f9-ae94-4a27-9e0a-4f9bbcd2d1fe admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:06.319426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c8f9-ae94-4a27-9e0a-4f9bbcd2d1fe admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:06.324749 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:06.325802 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:06.326255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:06.326676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] PATH_INFO: `/v3/projects/094589c070b84a279227bddc45e1de6f/users/6aee5302a91b4d509309e67649c9f385/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:06.329715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094589c070b84a279227bddc45e1de6f, user_id=6aee5302a91b4d509309e67649c9f385, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:06.332562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:06.346254 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1261/2514] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:46:06 2022] PUT /identity/v3/projects/094589c070b84a279227bddc45e1de6f/users/6aee5302a91b4d509309e67649c9f385/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:46:06.360412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc932a-499a-4a41-ac49-bbf2fca7722d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:06.360965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc932a-499a-4a41-ac49-bbf2fca7722d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:06.361063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc932a-499a-4a41-ac49-bbf2fca7722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:06.396190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bcbc932a-499a-4a41-ac49-bbf2fca7722d None None] MFA Rules not processed for user `6aee5302a91b4d509309e67649c9f385`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:06.397826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bcbc932a-499a-4a41-ac49-bbf2fca7722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:06.492706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1254/2515] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:06.493438 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:06.495169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:06.577399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f938ba9-79c8-45db-96aa-e18b669ddfc6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:06.581585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:06.582233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:06.582517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:06.582799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:06.622325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:06.650020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:06.651482 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:06.664168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1262/2516] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:46:13.011218 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc932a-499a-4a41-ac49-bbf2fca7722d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:13.021367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc932a-499a-4a41-ac49-bbf2fca7722d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:13.027964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dce88-1a27-4566-9c3f-ea031a4714dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:13.027964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dce88-1a27-4566-9c3f-ea031a4714dd service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:13.027964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dce88-1a27-4566-9c3f-ea031a4714dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:13.027964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dce88-1a27-4566-9c3f-ea031a4714dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:13.035782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dce88-1a27-4566-9c3f-ea031a4714dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:13.037237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dce88-1a27-4566-9c3f-ea031a4714dd service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:13.046514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1255/2517] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:16.691419 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=12 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:23.042378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:24.441591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:24.444147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:24.547846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0e79-e54a-45d3-b174-98309c2b1cea service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:24.559378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:24.560764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:24.561159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:24.561459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:24.572528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:24.599050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:24.602489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:24.631345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1263/2518] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:25.471412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a3f4-1abc-4851-8d11-ed510758ea71 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:25.471901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a3f4-1abc-4851-8d11-ed510758ea71 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:25.472262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a3f4-1abc-4851-8d11-ed510758ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:25.494072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9033a3f4-1abc-4851-8d11-ed510758ea71 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:25.495330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9033a3f4-1abc-4851-8d11-ed510758ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:25.563019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1256/2519] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:46:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:25.580199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:25.580199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:25.680092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f1c79-03e9-4ce4-8b0f-682eb666b58c service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:25.687120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fc0c2-e32b-438e-b597-7261c2149499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:25.687836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc0c2-e32b-438e-b597-7261c2149499 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:25.688115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc0c2-e32b-438e-b597-7261c2149499 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:25.689516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fc0c2-e32b-438e-b597-7261c2149499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:25.698894 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fc0c2-e32b-438e-b597-7261c2149499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:25.700632 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fc0c2-e32b-438e-b597-7261c2149499 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:25.709798 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1264/2520] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:46:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:46:35.556281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:35.706225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=66 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:37.294554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a3f4-1abc-4851-8d11-ed510758ea71 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:37.296030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9033a3f4-1abc-4851-8d11-ed510758ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:37.354705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a3f4-1abc-4851-8d11-ed510758ea71 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:37.358344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:37.358983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:37.359262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:37.359535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:37.361325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:37.425702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:37.427524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:37.438238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1257/2521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:40.702958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34873f24-e040-46d0-a491-ce90670db7bf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:40.703642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34873f24-e040-46d0-a491-ce90670db7bf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:40.703947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34873f24-e040-46d0-a491-ce90670db7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:40.730674 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-34873f24-e040-46d0-a491-ce90670db7bf None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:40.733385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-34873f24-e040-46d0-a491-ce90670db7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:40.747768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1265/2522] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jun 15 00:46:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:40.761807 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:40.773989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dfe67-7f30-4828-9c07-a9cf5fd6ccb0 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:40.779135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:40.779780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:40.785019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:40.785019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:40.790795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:40.792436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:40.801554 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1258/2523] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:46:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:46:41.745528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34873f24-e040-46d0-a491-ce90670db7bf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:41.745528 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-34873f24-e040-46d0-a491-ce90670db7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:41.817978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34873f24-e040-46d0-a491-ce90670db7bf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:41.823004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:41.823681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:41.823962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:41.824240 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:41.825991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:41.840948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:41.843002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:41.849034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:41.850700 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:41.863067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1266/2524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:41.868591 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d82c6-6371-4c5c-a49b-a5c294a7a642 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:41.873998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:41.874937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:41.875293 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:41.875638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] PATH_INFO: `/v3/users/d9a0bbb1f50c42acb50dac254a653da4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:41.877523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a0bbb1f50c42acb50dac254a653da4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:41.880338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:41.956665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:41.967044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b662-02ff-49ef-be77-723816ffe43e service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:41.971916 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:41.972788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:41.973072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:41.973347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] PATH_INFO: `/v3/users/4892dc432e36494497a880f669e37929` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:41.974637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4892dc432e36494497a880f669e37929)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:41.976631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:42.094252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a0bbb1f50c42acb50dac254a653da4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.182945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a0bbb1f50c42acb50dac254a653da4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.196897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a0bbb1f50c42acb50dac254a653da4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.197709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a0bbb1f50c42acb50dac254a653da4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.204405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7773034-7cf2-4c59-aba5-406303840f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a0bbb1f50c42acb50dac254a653da4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.210227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1259/2525] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:46:41 2022] DELETE /identity/v3/users/d9a0bbb1f50c42acb50dac254a653da4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:42.228345 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4892dc432e36494497a880f669e37929'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.236323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4892dc432e36494497a880f669e37929'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.336582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4892dc432e36494497a880f669e37929'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.337206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4892dc432e36494497a880f669e37929'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.354222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4892dc432e36494497a880f669e37929'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.360328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1267/2526] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:46:41 2022] DELETE /identity/v3/users/4892dc432e36494497a880f669e37929 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:46:42.365348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6e465-3a51-472f-8da9-61e83c3d57c2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:42.365704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6e465-3a51-472f-8da9-61e83c3d57c2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:42.366083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6e465-3a51-472f-8da9-61e83c3d57c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:42.384002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e1d6e465-3a51-472f-8da9-61e83c3d57c2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:42.385166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e1d6e465-3a51-472f-8da9-61e83c3d57c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:42.389462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:42.444228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1260/2527] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:42.454141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:42.455630 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:42.457448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6e465-3a51-472f-8da9-61e83c3d57c2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:42.458919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e1d6e465-3a51-472f-8da9-61e83c3d57c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:42.475035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6e465-3a51-472f-8da9-61e83c3d57c2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:42.483223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:42.484099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:42.484706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:42.491683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] PATH_INFO: `/v3/projects/30f2ff4320764a69bb987d567aed9201` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:42.491683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f2ff4320764a69bb987d567aed9201)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:42.491683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:42.518171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08ae44-dc5b-4883-8270-93e77dfd2859 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:42.522325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09ff0c-9897-4a08-9e06-5be736836bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:42.523041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ff0c-9897-4a08-9e06-5be736836bfe service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:42.523333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ff0c-9897-4a08-9e06-5be736836bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:42.523609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09ff0c-9897-4a08-9e06-5be736836bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:42.532639 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09ff0c-9897-4a08-9e06-5be736836bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:42.534079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09ff0c-9897-4a08-9e06-5be736836bfe service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:42.538659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:42.545053 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1268/2528] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:42.617197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f2ff4320764a69bb987d567aed9201', 'request_id': 'req-9932560b-a7b0-4430-86ea-113a5ace40b9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.623222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f2ff4320764a69bb987d567aed9201', 'request_id': 'req-9932560b-a7b0-4430-86ea-113a5ace40b9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.630226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f2ff4320764a69bb987d567aed9201', 'request_id': 'req-9932560b-a7b0-4430-86ea-113a5ace40b9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.702200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] The token cache is being invalidate because project 30f2ff4320764a69bb987d567aed9201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:46:42.702511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.703171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9932560b-a7b0-4430-86ea-113a5ace40b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:42.704797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1261/2529] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:46:42 2022] DELETE /identity/v3/projects/30f2ff4320764a69bb987d567aed9201 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:42.714920 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9a156-6749-4a8f-b6ac-000c125cd5bc None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:42.715216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9a156-6749-4a8f-b6ac-000c125cd5bc None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:42.715495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9a156-6749-4a8f-b6ac-000c125cd5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:42.740018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bbb9a156-6749-4a8f-b6ac-000c125cd5bc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:42.741475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bbb9a156-6749-4a8f-b6ac-000c125cd5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:42.805555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1269/2530] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:42.813029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8fe9-1a84-4595-be3f-c78a7b2e7c15 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:42.813442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8fe9-1a84-4595-be3f-c78a7b2e7c15 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:42.813658 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8fe9-1a84-4595-be3f-c78a7b2e7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:42.833855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-365e8fe9-1a84-4595-be3f-c78a7b2e7c15 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:42.835066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-365e8fe9-1a84-4595-be3f-c78a7b2e7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:42.843033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1262/2531] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:42.847335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9a156-6749-4a8f-b6ac-000c125cd5bc None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:42.858057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9a156-6749-4a8f-b6ac-000c125cd5bc None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:42.862957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:42.863616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:42.863928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:42.864317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:42.865055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:46:42.865366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:42.867055 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:42.879339 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1270/2532] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:46:42.883774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e8fe9-1a84-4595-be3f-c78a7b2e7c15 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:42.893307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e8fe9-1a84-4595-be3f-c78a7b2e7c15 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:42.898884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d728bb-4369-407d-9cc2-ea6bcce7fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:42.899536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d728bb-4369-407d-9cc2-ea6bcce7fea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:42.899824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d728bb-4369-407d-9cc2-ea6bcce7fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:42.900142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d728bb-4369-407d-9cc2-ea6bcce7fea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:42.900919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d728bb-4369-407d-9cc2-ea6bcce7fea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:42.902833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d728bb-4369-407d-9cc2-ea6bcce7fea0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:42.909467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:42.911323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:42.929008 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90fd2-d31a-4f84-a051-5cfa3ec8a3e0 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:42.935082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:42.936036 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:42.936435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:42.936611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] PATH_INFO: `/v3/projects/b7a2b86ec49e4cdd9cda7296dbca8642` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:42.937898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a2b86ec49e4cdd9cda7296dbca8642)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:42.939757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:43.001095 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1263/2533] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:46:42 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:43.005646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d728bb-4369-407d-9cc2-ea6bcce7fea0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:43.041818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a2b86ec49e4cdd9cda7296dbca8642', 'request_id': 'req-2db63c30-6c13-4e14-950a-bb0fba41daf7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.048298 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a2b86ec49e4cdd9cda7296dbca8642', 'request_id': 'req-2db63c30-6c13-4e14-950a-bb0fba41daf7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.055486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a2b86ec49e4cdd9cda7296dbca8642', 'request_id': 'req-2db63c30-6c13-4e14-950a-bb0fba41daf7'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.064088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:43.069714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d728bb-4369-407d-9cc2-ea6bcce7fea0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:43.124689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:43.125360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:43.125637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:43.125919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:43.126598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:43.129088 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:43.153989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] The token cache is being invalidate because project b7a2b86ec49e4cdd9cda7296dbca8642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:46:43.154283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.154927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.156595 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1271/2534] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:46:42 2022] DELETE /identity/v3/projects/b7a2b86ec49e4cdd9cda7296dbca8642 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:43.160455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:43.161735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:43.175436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db63c30-6c13-4e14-950a-bb0fba41daf7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:43.180294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:43.181208 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:43.181480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:43.181750 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] PATH_INFO: `/v3/users/6aee5302a91b4d509309e67649c9f385` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:43.182949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aee5302a91b4d509309e67649c9f385)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:43.184937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:43.213486 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1264/2535] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:46:43 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:46:43.217497 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:43.219176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:43.230824 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915055a-f358-4f75-87f3-13044c643e5c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:43.235735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead625c1-f162-45fe-8f3d-4388afe9fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:43.236440 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead625c1-f162-45fe-8f3d-4388afe9fbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:43.236724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead625c1-f162-45fe-8f3d-4388afe9fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:43.238367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead625c1-f162-45fe-8f3d-4388afe9fbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:43.238367 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead625c1-f162-45fe-8f3d-4388afe9fbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:43.239825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead625c1-f162-45fe-8f3d-4388afe9fbc5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:43.250547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1265/2536] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:46:43.255025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead625c1-f162-45fe-8f3d-4388afe9fbc5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:43.266139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead625c1-f162-45fe-8f3d-4388afe9fbc5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:43.271052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7eda7a-1999-46df-a46a-455d301ab475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:43.271869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7eda7a-1999-46df-a46a-455d301ab475 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:43.272186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7eda7a-1999-46df-a46a-455d301ab475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:43.272462 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7eda7a-1999-46df-a46a-455d301ab475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:43.273279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7eda7a-1999-46df-a46a-455d301ab475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:43.274918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7eda7a-1999-46df-a46a-455d301ab475 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:43.286242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1266/2537] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:46:43.290350 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7eda7a-1999-46df-a46a-455d301ab475 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:43.301349 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7eda7a-1999-46df-a46a-455d301ab475 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:43.306441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592116b-1ec4-4d3e-90a8-cc367d129935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:43.307272 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592116b-1ec4-4d3e-90a8-cc367d129935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:43.307726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592116b-1ec4-4d3e-90a8-cc367d129935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:43.308059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592116b-1ec4-4d3e-90a8-cc367d129935 admin admin] PATH_INFO: `/v3/projects/c73dcc78ab7c47abbb0dceebb5e212f2/users/3e857898104242699e7590b527c2631f/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:43.325158 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592116b-1ec4-4d3e-90a8-cc367d129935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73dcc78ab7c47abbb0dceebb5e212f2, user_id=3e857898104242699e7590b527c2631f, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:43.328296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592116b-1ec4-4d3e-90a8-cc367d129935 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:43.363026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aee5302a91b4d509309e67649c9f385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.370821 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aee5302a91b4d509309e67649c9f385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.418458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1267/2538] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:46:43 2022] PUT /identity/v3/projects/c73dcc78ab7c47abbb0dceebb5e212f2/users/3e857898104242699e7590b527c2631f/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:46:43.423769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08247ed-c4bc-4eb8-850e-dd4ef1549875 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:43.424195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08247ed-c4bc-4eb8-850e-dd4ef1549875 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:43.424543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08247ed-c4bc-4eb8-850e-dd4ef1549875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:43.434081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aee5302a91b4d509309e67649c9f385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.435037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aee5302a91b4d509309e67649c9f385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.436653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:43.442571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f08247ed-c4bc-4eb8-850e-dd4ef1549875 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:43.443788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f08247ed-c4bc-4eb8-850e-dd4ef1549875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:43.449973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aee5302a91b4d509309e67649c9f385'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:43.457408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1272/2539] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:46:43 2022] DELETE /identity/v3/users/6aee5302a91b4d509309e67649c9f385 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:46:43.521142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1268/2540] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:43.532779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:43.534273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:43.594809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2769e8-b86c-468e-8bed-69180430af50 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:43.598504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c4167-a0a5-4b35-ac77-f793a213d57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:43.599151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4167-a0a5-4b35-ac77-f793a213d57b service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:43.599430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4167-a0a5-4b35-ac77-f793a213d57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:43.599703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4167-a0a5-4b35-ac77-f793a213d57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:43.658934 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c4167-a0a5-4b35-ac77-f793a213d57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:43.660423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c4167-a0a5-4b35-ac77-f793a213d57b service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:43.669966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1273/2541] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:43.909187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08247ed-c4bc-4eb8-850e-dd4ef1549875 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:43.910753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f08247ed-c4bc-4eb8-850e-dd4ef1549875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:43.922746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08247ed-c4bc-4eb8-850e-dd4ef1549875 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:43.941901 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:43.942788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:43.943067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:43.943340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] PATH_INFO: `/v3/projects/094589c070b84a279227bddc45e1de6f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:43.944599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094589c070b84a279227bddc45e1de6f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:43.946517 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:44.052524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:44.058391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094589c070b84a279227bddc45e1de6f', 'request_id': 'req-fd7b0533-6a31-4848-a54a-c731b9318b58'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:44.063783 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094589c070b84a279227bddc45e1de6f', 'request_id': 'req-fd7b0533-6a31-4848-a54a-c731b9318b58'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:44.070602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094589c070b84a279227bddc45e1de6f', 'request_id': 'req-fd7b0533-6a31-4848-a54a-c731b9318b58'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:44.182323 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] The token cache is being invalidate because project 094589c070b84a279227bddc45e1de6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:46:44.186222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:44.186222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fd7b0533-6a31-4848-a54a-c731b9318b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:44.186222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1269/2542] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:46:43 2022] DELETE /identity/v3/projects/094589c070b84a279227bddc45e1de6f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:44.189933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811acc47-640b-4dad-b8c9-70174bc4dc06 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.190398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811acc47-640b-4dad-b8c9-70174bc4dc06 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.190560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811acc47-640b-4dad-b8c9-70174bc4dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.209774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-811acc47-640b-4dad-b8c9-70174bc4dc06 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:44.211013 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-811acc47-640b-4dad-b8c9-70174bc4dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:44.270553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1274/2543] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:44.278100 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6093f9-9da7-4764-a265-d940331386e6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.278519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6093f9-9da7-4764-a265-d940331386e6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.278797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6093f9-9da7-4764-a265-d940331386e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.298296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-af6093f9-9da7-4764-a265-d940331386e6 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:44.299482 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-af6093f9-9da7-4764-a265-d940331386e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:44.307873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1270/2544] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:44.312080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811acc47-640b-4dad-b8c9-70174bc4dc06 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:44.321691 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811acc47-640b-4dad-b8c9-70174bc4dc06 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:44.326215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:44.326862 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.327147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.327426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.328203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:46:44.328514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:44.330100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:44.341388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1275/2545] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:46:44.345506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6093f9-9da7-4764-a265-d940331386e6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:44.355447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6093f9-9da7-4764-a265-d940331386e6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:44.360009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0eb7-0cdc-4d05-ac56-783d32a5ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:44.360644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0eb7-0cdc-4d05-ac56-783d32a5ab42 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.360923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0eb7-0cdc-4d05-ac56-783d32a5ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.361192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b0eb7-0cdc-4d05-ac56-783d32a5ab42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.361879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b0eb7-0cdc-4d05-ac56-783d32a5ab42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:44.364498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b0eb7-0cdc-4d05-ac56-783d32a5ab42 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:44.456266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1271/2546] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:46:44 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:46:44.457466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:44.467436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d824-306b-4b4a-ac0a-2be6ef0c5da4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:44.480224 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:44.523507 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e9a22-f2f5-4326-8b05-1fd9e83d5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:44.524213 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9a22-f2f5-4326-8b05-1fd9e83d5e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.524496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9a22-f2f5-4326-8b05-1fd9e83d5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.524772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9a22-f2f5-4326-8b05-1fd9e83d5e28 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.525472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e9a22-f2f5-4326-8b05-1fd9e83d5e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:44.527426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e9a22-f2f5-4326-8b05-1fd9e83d5e28 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:44.632491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1276/2547] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:46:44 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:44.633580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0eb7-0cdc-4d05-ac56-783d32a5ab42 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:44.645558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b0eb7-0cdc-4d05-ac56-783d32a5ab42 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:44.650504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddefb6b-9b09-4fad-9724-d31eddfeb3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:44.651164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddefb6b-9b09-4fad-9724-d31eddfeb3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.651439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddefb6b-9b09-4fad-9724-d31eddfeb3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.651711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddefb6b-9b09-4fad-9724-d31eddfeb3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.652464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddefb6b-9b09-4fad-9724-d31eddfeb3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:44.654083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddefb6b-9b09-4fad-9724-d31eddfeb3bc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:44.667015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1272/2548] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:44.670269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e9a22-f2f5-4326-8b05-1fd9e83d5e28 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:44.680658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e9a22-f2f5-4326-8b05-1fd9e83d5e28 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:44.685276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e927a2-9135-4e96-9fda-26b0d1dbbbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:44.688130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e927a2-9135-4e96-9fda-26b0d1dbbbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.688130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e927a2-9135-4e96-9fda-26b0d1dbbbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.688130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e927a2-9135-4e96-9fda-26b0d1dbbbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.688130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e927a2-9135-4e96-9fda-26b0d1dbbbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:44.688781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e927a2-9135-4e96-9fda-26b0d1dbbbf0 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:44.698553 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1277/2549] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:46:44.702761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddefb6b-9b09-4fad-9724-d31eddfeb3bc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:44.713311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddefb6b-9b09-4fad-9724-d31eddfeb3bc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:44.717795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d8d0-f03c-470c-95b9-2ef2d2d0ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:44.718690 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d8d0-f03c-470c-95b9-2ef2d2d0ab8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.718967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d8d0-f03c-470c-95b9-2ef2d2d0ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.719242 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d8d0-f03c-470c-95b9-2ef2d2d0ab8c admin admin] PATH_INFO: `/v3/projects/8899104897e444a8ab5af9f88c85ccc8/users/96021335a7c9413a81c6ae2803ec1c2c/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.734370 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4d8d0-f03c-470c-95b9-2ef2d2d0ab8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8899104897e444a8ab5af9f88c85ccc8, user_id=96021335a7c9413a81c6ae2803ec1c2c, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:44.737125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4d8d0-f03c-470c-95b9-2ef2d2d0ab8c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:44.811178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1273/2550] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:46:44 2022] PUT /identity/v3/projects/8899104897e444a8ab5af9f88c85ccc8/users/96021335a7c9413a81c6ae2803ec1c2c/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:44.822217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2c72-96df-4f0a-b340-1ccc56374810 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.822513 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2c72-96df-4f0a-b340-1ccc56374810 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.822790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c2c72-96df-4f0a-b340-1ccc56374810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.849325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-817c2c72-96df-4f0a-b340-1ccc56374810 None None] MFA Rules not processed for user `96021335a7c9413a81c6ae2803ec1c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:44.850524 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-817c2c72-96df-4f0a-b340-1ccc56374810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:44.918317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1278/2551] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:44.922504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d8d0-f03c-470c-95b9-2ef2d2d0ab8c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:44.990893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d8d0-f03c-470c-95b9-2ef2d2d0ab8c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:44.995828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70505497-2149-47c8-b81a-f1bf9ed21b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:44.996492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505497-2149-47c8-b81a-f1bf9ed21b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:44.996845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505497-2149-47c8-b81a-f1bf9ed21b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:44.997182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505497-2149-47c8-b81a-f1bf9ed21b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:44.997955 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70505497-2149-47c8-b81a-f1bf9ed21b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:44.999929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70505497-2149-47c8-b81a-f1bf9ed21b81 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:45.096429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1274/2552] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:46:44 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:45.097656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c2c72-96df-4f0a-b340-1ccc56374810 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:45.109347 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c2c72-96df-4f0a-b340-1ccc56374810 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:45.168990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf055b7-a947-493f-82ab-707712d3e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:45.169673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf055b7-a947-493f-82ab-707712d3e9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:45.169954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf055b7-a947-493f-82ab-707712d3e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:45.170232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf055b7-a947-493f-82ab-707712d3e9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:45.170925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf055b7-a947-493f-82ab-707712d3e9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:45.172996 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf055b7-a947-493f-82ab-707712d3e9d5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:45.297365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1279/2553] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:46:45 2022] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:45.301388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70505497-2149-47c8-b81a-f1bf9ed21b81 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:45.312937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70505497-2149-47c8-b81a-f1bf9ed21b81 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:45.318197 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbf76e-b3d6-4a4c-9d47-fc7d755a796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:45.319021 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbf76e-b3d6-4a4c-9d47-fc7d755a796a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:45.319369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbf76e-b3d6-4a4c-9d47-fc7d755a796a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:45.319718 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbf76e-b3d6-4a4c-9d47-fc7d755a796a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:45.320596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbf76e-b3d6-4a4c-9d47-fc7d755a796a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:45.322289 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbf76e-b3d6-4a4c-9d47-fc7d755a796a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:45.337868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1275/2554] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:45.339178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf055b7-a947-493f-82ab-707712d3e9d5 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:45.350764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf055b7-a947-493f-82ab-707712d3e9d5 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:45.356217 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc3d64-caea-44d0-84e2-4de26c269dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:45.357118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc3d64-caea-44d0-84e2-4de26c269dde admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:45.357397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc3d64-caea-44d0-84e2-4de26c269dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:45.357668 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc3d64-caea-44d0-84e2-4de26c269dde admin admin] PATH_INFO: `/v3/projects/a978b578c209475d91f1b4d268e2f830/users/366286fb9ee44dae82cc3e6c5c8030ef/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:45.374018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:45.377292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc3d64-caea-44d0-84e2-4de26c269dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a978b578c209475d91f1b4d268e2f830, user_id=366286fb9ee44dae82cc3e6c5c8030ef, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:45.380104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc3d64-caea-44d0-84e2-4de26c269dde admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:45.447068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1280/2555] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:46:45 2022] PUT /identity/v3/projects/a978b578c209475d91f1b4d268e2f830/users/366286fb9ee44dae82cc3e6c5c8030ef/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:45.450687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbf76e-b3d6-4a4c-9d47-fc7d755a796a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:45.461542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbf76e-b3d6-4a4c-9d47-fc7d755a796a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:45.514970 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:45.535445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c632c-1efc-4417-8a7c-7211ce133e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:45.536241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c632c-1efc-4417-8a7c-7211ce133e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:45.536524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c632c-1efc-4417-8a7c-7211ce133e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:45.536800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c632c-1efc-4417-8a7c-7211ce133e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:45.537565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c632c-1efc-4417-8a7c-7211ce133e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:45.539156 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c632c-1efc-4417-8a7c-7211ce133e0b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:45.550424 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1276/2556] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:45.554174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc3d64-caea-44d0-84e2-4de26c269dde admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:45.564669 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc3d64-caea-44d0-84e2-4de26c269dde admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:45.570020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:45.570157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:45.570387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:45.570660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] PATH_INFO: `/v3/projects/a978b578c209475d91f1b4d268e2f830/users/366286fb9ee44dae82cc3e6c5c8030ef/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:45.572613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a978b578c209475d91f1b4d268e2f830, user_id=366286fb9ee44dae82cc3e6c5c8030ef, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:45.575372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:45.587344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1281/2557] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:46:45 2022] PUT /identity/v3/projects/a978b578c209475d91f1b4d268e2f830/users/366286fb9ee44dae82cc3e6c5c8030ef/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:45.598163 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6448fe-56d3-406c-8c59-97a36f268a37 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:45.600238 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6448fe-56d3-406c-8c59-97a36f268a37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:45.600590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6448fe-56d3-406c-8c59-97a36f268a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:45.627098 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bd6448fe-56d3-406c-8c59-97a36f268a37 None None] MFA Rules not processed for user `366286fb9ee44dae82cc3e6c5c8030ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:45.628387 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd6448fe-56d3-406c-8c59-97a36f268a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:45.705519 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1277/2558] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:46:45.714571 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:45.715963 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:45.802854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5634-97f2-4d6a-a583-7b7a51c2d8a7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:45.807174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822d2d1-9995-4379-993e-360585692ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:45.807867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822d2d1-9995-4379-993e-360585692ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:45.808191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822d2d1-9995-4379-993e-360585692ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:45.808469 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822d2d1-9995-4379-993e-360585692ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:45.820034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822d2d1-9995-4379-993e-360585692ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:45.821847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822d2d1-9995-4379-993e-360585692ed4 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:45.833375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1282/2559] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:45.882799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6448fe-56d3-406c-8c59-97a36f268a37 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:45.890703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd6448fe-56d3-406c-8c59-97a36f268a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:45.898233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6448fe-56d3-406c-8c59-97a36f268a37 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:45.902003 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:45.902656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:45.902936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:45.903212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:45.976077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:45.977511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:45.988058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1278/2560] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:49.025020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872d41-93e7-4fcf-9a4e-730400b70a1f None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:49.025499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872d41-93e7-4fcf-9a4e-730400b70a1f None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:49.025602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872d41-93e7-4fcf-9a4e-730400b70a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:49.064596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-81872d41-93e7-4fcf-9a4e-730400b70a1f None None] MFA Rules not processed for user `3e857898104242699e7590b527c2631f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:49.066430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-81872d41-93e7-4fcf-9a4e-730400b70a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:49.137149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1283/2561] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:49.153790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:49.155297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:49.227494 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:49.245744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca973c2-bf59-43fc-ad18-9721b228b8e3 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:49.260269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0a655-23fa-4b9b-a186-5eea807bd627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:49.261378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a655-23fa-4b9b-a186-5eea807bd627 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:49.261612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a655-23fa-4b9b-a186-5eea807bd627 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:49.261887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a655-23fa-4b9b-a186-5eea807bd627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:49.270779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0a655-23fa-4b9b-a186-5eea807bd627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:49.272422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0a655-23fa-4b9b-a186-5eea807bd627 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:49.281858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1279/2562] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:50.863809 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81872d41-93e7-4fcf-9a4e-730400b70a1f None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:50.932510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81872d41-93e7-4fcf-9a4e-730400b70a1f None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:50.938893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:50.940385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:50.941950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:50.941950 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] PATH_INFO: `/v3/users/96021335a7c9413a81c6ae2803ec1c2c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:50.943185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96021335a7c9413a81c6ae2803ec1c2c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:50.950003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:50.962978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:51.137173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96021335a7c9413a81c6ae2803ec1c2c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:51.148819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96021335a7c9413a81c6ae2803ec1c2c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:51.234158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96021335a7c9413a81c6ae2803ec1c2c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:51.235280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96021335a7c9413a81c6ae2803ec1c2c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:51.249338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96021335a7c9413a81c6ae2803ec1c2c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:51.258462 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1284/2563] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:46:50 2022] DELETE /identity/v3/users/96021335a7c9413a81c6ae2803ec1c2c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:51.262989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12c1a-b25c-41df-aae9-3fd8494a356d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:51.263526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12c1a-b25c-41df-aae9-3fd8494a356d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:51.263526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b12c1a-b25c-41df-aae9-3fd8494a356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:51.282822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b8b12c1a-b25c-41df-aae9-3fd8494a356d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:51.284817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b8b12c1a-b25c-41df-aae9-3fd8494a356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:51.381925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1280/2564] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:51.392200 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:51.394425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:51.481037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda98f2-c987-484c-a1a2-8a0f9899b8c6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:51.484812 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3986-b0a9-4842-b4e5-52ab2cdb04a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:51.485971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3986-b0a9-4842-b4e5-52ab2cdb04a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:51.486381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3986-b0a9-4842-b4e5-52ab2cdb04a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:51.486743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3986-b0a9-4842-b4e5-52ab2cdb04a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:51.502804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f3986-b0a9-4842-b4e5-52ab2cdb04a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:51.502804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f3986-b0a9-4842-b4e5-52ab2cdb04a3 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:51.520515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1285/2565] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:51.540341 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454121-8ffb-4081-8096-62186a1110ca None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:51.540937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454121-8ffb-4081-8096-62186a1110ca None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:51.541348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454121-8ffb-4081-8096-62186a1110ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:51.562923 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-72454121-8ffb-4081-8096-62186a1110ca None None] MFA Rules not processed for user `3e857898104242699e7590b527c2631f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:51.566212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-72454121-8ffb-4081-8096-62186a1110ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:51.633019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1281/2566] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:46:52.068508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3986-b0a9-4842-b4e5-52ab2cdb04a3 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:52.079052 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3986-b0a9-4842-b4e5-52ab2cdb04a3 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:52.083799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:52.084723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:52.085205 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:52.085690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:52.087898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:52.101454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:52.103783 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:52.115742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1286/2567] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:52.299395 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454121-8ffb-4081-8096-62186a1110ca None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:52.300892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-72454121-8ffb-4081-8096-62186a1110ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:52.334282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454121-8ffb-4081-8096-62186a1110ca None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:52.345413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:52.346710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:52.347645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:52.348078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] PATH_INFO: `/v3/projects/8899104897e444a8ab5af9f88c85ccc8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:52.349719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8899104897e444a8ab5af9f88c85ccc8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:52.355117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:52.467397 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8899104897e444a8ab5af9f88c85ccc8', 'request_id': 'req-3a503096-68b8-4019-8018-a1b5fb3bd086'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:52.473997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8899104897e444a8ab5af9f88c85ccc8', 'request_id': 'req-3a503096-68b8-4019-8018-a1b5fb3bd086'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:52.481114 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8899104897e444a8ab5af9f88c85ccc8', 'request_id': 'req-3a503096-68b8-4019-8018-a1b5fb3bd086'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:52.568407 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] The token cache is being invalidate because project 8899104897e444a8ab5af9f88c85ccc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:46:52.575099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:52.575099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:52.575099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1282/2568] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:46:52 2022] DELETE /identity/v3/projects/8899104897e444a8ab5af9f88c85ccc8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:52.576203 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:52.592297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631fff-9d1d-4bbb-8891-4eecc9cbd955 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:52.670692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:52.670692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:52.670692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:52.670692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] PATH_INFO: `/v3/users/366286fb9ee44dae82cc3e6c5c8030ef` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:52.671378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=366286fb9ee44dae82cc3e6c5c8030ef)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:52.674458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:52.699421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:52.905174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366286fb9ee44dae82cc3e6c5c8030ef'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:52.912407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366286fb9ee44dae82cc3e6c5c8030ef'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:52.993724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366286fb9ee44dae82cc3e6c5c8030ef'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:52.994335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366286fb9ee44dae82cc3e6c5c8030ef'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:53.008429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d54daf71-d082-4d62-a8fd-bdee1b6e71ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366286fb9ee44dae82cc3e6c5c8030ef'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:53.015351 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1287/2569] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:46:52 2022] DELETE /identity/v3/users/366286fb9ee44dae82cc3e6c5c8030ef => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:53.503782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:53.506309 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:53.518729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a503096-68b8-4019-8018-a1b5fb3bd086 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:53.529032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:53.578477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:53.579265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:53.579541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:53.579813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] PATH_INFO: `/v3/projects/a978b578c209475d91f1b4d268e2f830` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:53.581610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a978b578c209475d91f1b4d268e2f830)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:53.583491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:53.679978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a978b578c209475d91f1b4d268e2f830', 'request_id': 'req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:53.686036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a978b578c209475d91f1b4d268e2f830', 'request_id': 'req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:53.694404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a978b578c209475d91f1b4d268e2f830', 'request_id': 'req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:53.788122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] The token cache is being invalidate because project a978b578c209475d91f1b4d268e2f830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:46:53.788470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:53.789123 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f3d3ff73-fcae-4f56-a5fd-4baf60e7c894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:53.790659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1283/2570] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:46:53 2022] DELETE /identity/v3/projects/a978b578c209475d91f1b4d268e2f830 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:53.795697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393bdb-81af-4ce9-a4aa-3d6d5e6ba378 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:53.796209 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393bdb-81af-4ce9-a4aa-3d6d5e6ba378 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:53.796364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393bdb-81af-4ce9-a4aa-3d6d5e6ba378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:53.814070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-97393bdb-81af-4ce9-a4aa-3d6d5e6ba378 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:53.815281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-97393bdb-81af-4ce9-a4aa-3d6d5e6ba378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:53.876896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1288/2571] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:53.885493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ab66-20b5-451a-a5de-45651a005a6f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:53.885802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ab66-20b5-451a-a5de-45651a005a6f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:53.886066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7ab66-20b5-451a-a5de-45651a005a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:53.904443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-30a7ab66-20b5-451a-a5de-45651a005a6f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:53.905651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-30a7ab66-20b5-451a-a5de-45651a005a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:53.914075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1284/2572] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:53.917925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393bdb-81af-4ce9-a4aa-3d6d5e6ba378 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:53.928311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393bdb-81af-4ce9-a4aa-3d6d5e6ba378 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:53.933292 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:53.933948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:53.934232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:53.934510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:53.935239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:46:53.935549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:53.937256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:53.949505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1289/2573] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:46:53.953790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7ab66-20b5-451a-a5de-45651a005a6f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:53.963071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7ab66-20b5-451a-a5de-45651a005a6f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:53.967716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3db561-2b12-4df2-894f-b8a650df0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:53.968396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3db561-2b12-4df2-894f-b8a650df0459 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:53.968681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3db561-2b12-4df2-894f-b8a650df0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:53.968956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3db561-2b12-4df2-894f-b8a650df0459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:53.969652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3db561-2b12-4df2-894f-b8a650df0459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:53.971613 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3db561-2b12-4df2-894f-b8a650df0459 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:54.150121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1285/2574] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:46:53 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:54.154076 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:54.164643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455b9b1-4438-45ce-beae-c7074b25bfb6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:54.225636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0da7-2836-465d-9c99-95c77a9e5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:54.226359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0da7-2836-465d-9c99-95c77a9e5d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:54.226680 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0da7-2836-465d-9c99-95c77a9e5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:54.226953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0da7-2836-465d-9c99-95c77a9e5d76 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:54.227629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0da7-2836-465d-9c99-95c77a9e5d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:54.229653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0da7-2836-465d-9c99-95c77a9e5d76 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:54.325390 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1290/2575] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:46:54 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:46:54.329629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3db561-2b12-4df2-894f-b8a650df0459 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:54.340140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3db561-2b12-4df2-894f-b8a650df0459 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:54.344793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e7a72-be20-4b13-8a8f-ea1465438699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:54.345438 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7a72-be20-4b13-8a8f-ea1465438699 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:54.345719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7a72-be20-4b13-8a8f-ea1465438699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:54.345991 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e7a72-be20-4b13-8a8f-ea1465438699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:54.347219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e7a72-be20-4b13-8a8f-ea1465438699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:54.348841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e7a72-be20-4b13-8a8f-ea1465438699 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:54.358911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1286/2576] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:54.363548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0da7-2836-465d-9c99-95c77a9e5d76 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:54.373679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0da7-2836-465d-9c99-95c77a9e5d76 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:54.378737 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0832a6-45c3-46f6-b9a3-e85033e994b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:54.379399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0832a6-45c3-46f6-b9a3-e85033e994b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:54.379843 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0832a6-45c3-46f6-b9a3-e85033e994b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:54.379987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0832a6-45c3-46f6-b9a3-e85033e994b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:54.381097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0832a6-45c3-46f6-b9a3-e85033e994b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:54.383215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0832a6-45c3-46f6-b9a3-e85033e994b1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:54.395107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1291/2577] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:46:54.401062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e7a72-be20-4b13-8a8f-ea1465438699 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:54.412072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e7a72-be20-4b13-8a8f-ea1465438699 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:54.416632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:54.417500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:54.417781 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:54.418185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] PATH_INFO: `/v3/projects/1588ba5290ce4b0487706c9c3d02501e/users/620aa4fd99dc4220aff176192251557a/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:54.433708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1588ba5290ce4b0487706c9c3d02501e, user_id=620aa4fd99dc4220aff176192251557a, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:54.436732 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:54.520726 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1287/2578] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:46:54 2022] PUT /identity/v3/projects/1588ba5290ce4b0487706c9c3d02501e/users/620aa4fd99dc4220aff176192251557a/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:46:54.530947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bcab-672e-4036-86fd-a92a914950ac None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:54.531264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bcab-672e-4036-86fd-a92a914950ac None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:54.531542 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bcab-672e-4036-86fd-a92a914950ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:54.539252 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:54.559649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c3d1bcab-672e-4036-86fd-a92a914950ac None None] MFA Rules not processed for user `620aa4fd99dc4220aff176192251557a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:54.560940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c3d1bcab-672e-4036-86fd-a92a914950ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:54.637038 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1292/2579] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:54.648652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:54.650413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:54.693022 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:54.706644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c98431-0053-4d67-8bcf-8deed81ed133 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:54.710229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c55980-5515-4407-a830-4974f4313f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:54.710866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c55980-5515-4407-a830-4974f4313f81 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:54.711146 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c55980-5515-4407-a830-4974f4313f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:54.711413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c55980-5515-4407-a830-4974f4313f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:54.719636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c55980-5515-4407-a830-4974f4313f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:54.721092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c55980-5515-4407-a830-4974f4313f81 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:54.731267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1288/2580] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:56.748365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1bcab-672e-4036-86fd-a92a914950ac None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:56.748365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c3d1bcab-672e-4036-86fd-a92a914950ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:56.833278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1bcab-672e-4036-86fd-a92a914950ac None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:56.839381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065697c9-d4bc-46df-86f6-9d4229af176a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:56.840007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065697c9-d4bc-46df-86f6-9d4229af176a service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:56.840293 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065697c9-d4bc-46df-86f6-9d4229af176a service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:56.840570 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065697c9-d4bc-46df-86f6-9d4229af176a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:56.842385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-065697c9-d4bc-46df-86f6-9d4229af176a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:56.855661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065697c9-d4bc-46df-86f6-9d4229af176a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:56.857730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065697c9-d4bc-46df-86f6-9d4229af176a service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:56.874982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1293/2581] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:58.963695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c55980-5515-4407-a830-4974f4313f81 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:59.030496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c55980-5515-4407-a830-4974f4313f81 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:59.035063 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:59.036665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:59.036911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:59.037186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] PATH_INFO: `/v3/users/620aa4fd99dc4220aff176192251557a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:59.041971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=620aa4fd99dc4220aff176192251557a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:59.041971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:59.246809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620aa4fd99dc4220aff176192251557a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:59.313255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620aa4fd99dc4220aff176192251557a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:59.326229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620aa4fd99dc4220aff176192251557a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:59.326866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620aa4fd99dc4220aff176192251557a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:59.334404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620aa4fd99dc4220aff176192251557a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:46:59.340295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1289/2582] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:46:58 2022] DELETE /identity/v3/users/620aa4fd99dc4220aff176192251557a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:46:59.344744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa461-bf10-48a3-849f-a09c7604169e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:59.345205 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa461-bf10-48a3-849f-a09c7604169e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:59.345334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfa461-bf10-48a3-849f-a09c7604169e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:59.362113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6ccfa461-bf10-48a3-849f-a09c7604169e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:46:59.363297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6ccfa461-bf10-48a3-849f-a09c7604169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:59.419606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1294/2583] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:46:59.429078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:59.430460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:59.486800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65ca03-9dce-4433-baee-97d65b3658ab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:59.490266 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b7ba4-e7e3-45b8-9f73-3bd8ce558507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:59.490907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7ba4-e7e3-45b8-9f73-3bd8ce558507 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:59.491259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7ba4-e7e3-45b8-9f73-3bd8ce558507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:59.491533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b7ba4-e7e3-45b8-9f73-3bd8ce558507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:59.500546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b7ba4-e7e3-45b8-9f73-3bd8ce558507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:59.502023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b7ba4-e7e3-45b8-9f73-3bd8ce558507 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:59.511898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1290/2584] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:46:59.949960 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfa461-bf10-48a3-849f-a09c7604169e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:59.951497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6ccfa461-bf10-48a3-849f-a09c7604169e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:59.963713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfa461-bf10-48a3-849f-a09c7604169e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:59.968336 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:59.969189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:59.969576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:59.969822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] PATH_INFO: `/v3/projects/1588ba5290ce4b0487706c9c3d02501e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:59.970936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1588ba5290ce4b0487706c9c3d02501e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:59.973024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:59.992937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=100 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:00.102473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1588ba5290ce4b0487706c9c3d02501e', 'request_id': 'req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:00.107918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1588ba5290ce4b0487706c9c3d02501e', 'request_id': 'req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:00.114665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1588ba5290ce4b0487706c9c3d02501e', 'request_id': 'req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:00.181601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] The token cache is being invalidate because project 1588ba5290ce4b0487706c9c3d02501e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:00.181890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:00.182509 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-91f444cd-1a2f-4fd9-88ce-d89560dd6d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:00.184106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1295/2585] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:46:59 2022] DELETE /identity/v3/projects/1588ba5290ce4b0487706c9c3d02501e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:00.188946 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063df4c-84b8-4f91-afc2-38517fc90100 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.189402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063df4c-84b8-4f91-afc2-38517fc90100 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.189496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063df4c-84b8-4f91-afc2-38517fc90100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.196596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:00.206989 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e063df4c-84b8-4f91-afc2-38517fc90100 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:00.208254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e063df4c-84b8-4f91-afc2-38517fc90100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:00.266171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1291/2586] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:00.273889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d88a7-c66b-4208-80b2-4138f4788441 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.274177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d88a7-c66b-4208-80b2-4138f4788441 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.274457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d88a7-c66b-4208-80b2-4138f4788441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.292685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-261d88a7-c66b-4208-80b2-4138f4788441 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:00.293867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-261d88a7-c66b-4208-80b2-4138f4788441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:00.302124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1296/2587] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:00.306085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063df4c-84b8-4f91-afc2-38517fc90100 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:00.315886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063df4c-84b8-4f91-afc2-38517fc90100 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:00.320338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:00.320978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.321257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.321528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.322237 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:47:00.322538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:00.324138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:00.335369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1292/2588] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:47:00.339270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d88a7-c66b-4208-80b2-4138f4788441 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:00.348719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d88a7-c66b-4208-80b2-4138f4788441 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:00.353259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e20b-f75c-444f-9144-258778aa1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:00.353888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e20b-f75c-444f-9144-258778aa1418 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.354165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e20b-f75c-444f-9144-258778aa1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.354435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e20b-f75c-444f-9144-258778aa1418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.355107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3e20b-f75c-444f-9144-258778aa1418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:00.357020 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3e20b-f75c-444f-9144-258778aa1418 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:00.440697 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1297/2589] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:00 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:00.444828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:00.454799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69f8f5-6444-4d3b-81f5-c45e1ec3224c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:00.509059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644887a-ce73-4e63-b601-e528e1d32494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:00.509714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644887a-ce73-4e63-b601-e528e1d32494 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.509996 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644887a-ce73-4e63-b601-e528e1d32494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.510269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644887a-ce73-4e63-b601-e528e1d32494 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.510952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644887a-ce73-4e63-b601-e528e1d32494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:00.512904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644887a-ce73-4e63-b601-e528e1d32494 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:00.607973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1293/2590] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:00 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:47:00.609753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e20b-f75c-444f-9144-258778aa1418 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:00.620410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e20b-f75c-444f-9144-258778aa1418 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:00.625065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e040-d7db-48e9-92ae-65a40d60ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:00.625712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e040-d7db-48e9-92ae-65a40d60ccba admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.625998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e040-d7db-48e9-92ae-65a40d60ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.626273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e040-d7db-48e9-92ae-65a40d60ccba admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.626995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59e040-d7db-48e9-92ae-65a40d60ccba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:00.628631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59e040-d7db-48e9-92ae-65a40d60ccba admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:00.638702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1298/2591] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:00.642787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644887a-ce73-4e63-b601-e528e1d32494 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:00.653223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644887a-ce73-4e63-b601-e528e1d32494 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:00.657750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10fd96-b714-4c5e-9ae7-0fd6f89db8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:00.658392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10fd96-b714-4c5e-9ae7-0fd6f89db8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.658674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10fd96-b714-4c5e-9ae7-0fd6f89db8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.658951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10fd96-b714-4c5e-9ae7-0fd6f89db8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.659665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10fd96-b714-4c5e-9ae7-0fd6f89db8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:00.661971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10fd96-b714-4c5e-9ae7-0fd6f89db8e6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:00.671609 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1294/2592] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:00.675492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e040-d7db-48e9-92ae-65a40d60ccba admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:00.685167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e040-d7db-48e9-92ae-65a40d60ccba admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:00.689722 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:00.690583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.690866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.691142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] PATH_INFO: `/v3/projects/f6cea9baaf234f52ac4f57961662f474/users/0bf6e5932e2e4c7a845252d4e90cf147/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.705723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cea9baaf234f52ac4f57961662f474, user_id=0bf6e5932e2e4c7a845252d4e90cf147, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:00.708981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:00.806012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1299/2593] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:00 2022] PUT /identity/v3/projects/f6cea9baaf234f52ac4f57961662f474/users/0bf6e5932e2e4c7a845252d4e90cf147/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:00.817636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5655b95-106e-4456-8049-b935b2c06e67 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:00.819072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5655b95-106e-4456-8049-b935b2c06e67 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:00.819072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5655b95-106e-4456-8049-b935b2c06e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:00.846261 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b5655b95-106e-4456-8049-b935b2c06e67 None None] MFA Rules not processed for user `0bf6e5932e2e4c7a845252d4e90cf147`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:00.847520 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b5655b95-106e-4456-8049-b935b2c06e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:00.911250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:00.915325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1295/2594] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:00.926912 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:00.928747 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:01.012214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d79c2-760c-456a-9647-e397734e6f2a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:01.016303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68e751-334e-4d26-a8de-e6ac8f3894a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d6317775c343eaa9397254074647f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:01.016949 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68e751-334e-4d26-a8de-e6ac8f3894a1 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:01.017235 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68e751-334e-4d26-a8de-e6ac8f3894a1 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:01.017514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68e751-334e-4d26-a8de-e6ac8f3894a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:01.026139 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68e751-334e-4d26-a8de-e6ac8f3894a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:01.027588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68e751-334e-4d26-a8de-e6ac8f3894a1 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:01.036864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1300/2595] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:11.032376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:27.538911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5655b95-106e-4456-8049-b935b2c06e67 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:27.540435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b5655b95-106e-4456-8049-b935b2c06e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:27.596044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5655b95-106e-4456-8049-b935b2c06e67 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:27.599611 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f56cd-9890-496b-ae65-286782bd8fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:27.600279 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f56cd-9890-496b-ae65-286782bd8fba service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:27.600559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f56cd-9890-496b-ae65-286782bd8fba service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:27.600831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f56cd-9890-496b-ae65-286782bd8fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:27.602559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ba0f56cd-9890-496b-ae65-286782bd8fba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:27.663252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f56cd-9890-496b-ae65-286782bd8fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:27.664621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f56cd-9890-496b-ae65-286782bd8fba service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:27.673984 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1296/2596] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:29.085867 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68e751-334e-4d26-a8de-e6ac8f3894a1 service glance] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:29.096904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68e751-334e-4d26-a8de-e6ac8f3894a1 service glance] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:29.101574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:29.102446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:29.103027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:29.103027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] PATH_INFO: `/v3/users/0bf6e5932e2e4c7a845252d4e90cf147` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:29.104369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf6e5932e2e4c7a845252d4e90cf147)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:29.106284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:29.244222 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf6e5932e2e4c7a845252d4e90cf147'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:29.251997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf6e5932e2e4c7a845252d4e90cf147'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:29.347629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf6e5932e2e4c7a845252d4e90cf147'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:29.348288 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf6e5932e2e4c7a845252d4e90cf147'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:29.361815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf6e5932e2e4c7a845252d4e90cf147'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:29.371499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1301/2597] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:47:29 2022] DELETE /identity/v3/users/0bf6e5932e2e4c7a845252d4e90cf147 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:29.373932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0e4d-8045-4a5f-93ab-fea9ceb133d8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:29.374905 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0e4d-8045-4a5f-93ab-fea9ceb133d8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:29.375186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0e4d-8045-4a5f-93ab-fea9ceb133d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:29.394621 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-43fd0e4d-8045-4a5f-93ab-fea9ceb133d8 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:29.395833 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-43fd0e4d-8045-4a5f-93ab-fea9ceb133d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:29.467079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1297/2598] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:29.475206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:29.476692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:29.549176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c30c8f-ff44-4ddf-931c-8731e8a970d1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:29.554119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed5fa6-37d6-436a-8357-5c61f7910cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:29.554828 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5fa6-37d6-436a-8357-5c61f7910cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:29.555111 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5fa6-37d6-436a-8357-5c61f7910cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:29.555385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed5fa6-37d6-436a-8357-5c61f7910cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:29.565087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed5fa6-37d6-436a-8357-5c61f7910cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:29.566514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed5fa6-37d6-436a-8357-5c61f7910cc6 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:29.576819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1302/2599] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:29.964142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0e4d-8045-4a5f-93ab-fea9ceb133d8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:29.967202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-43fd0e4d-8045-4a5f-93ab-fea9ceb133d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:29.994652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0e4d-8045-4a5f-93ab-fea9ceb133d8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:29.994652 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:29.995422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:29.995736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:29.996042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] PATH_INFO: `/v3/projects/f6cea9baaf234f52ac4f57961662f474` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:29.997235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cea9baaf234f52ac4f57961662f474)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:29.999176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:30.100742 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:30.103378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cea9baaf234f52ac4f57961662f474', 'request_id': 'req-6ad88c90-98eb-4264-bdf2-700de843a12d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:30.108884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cea9baaf234f52ac4f57961662f474', 'request_id': 'req-6ad88c90-98eb-4264-bdf2-700de843a12d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:30.115020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cea9baaf234f52ac4f57961662f474', 'request_id': 'req-6ad88c90-98eb-4264-bdf2-700de843a12d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:30.187540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] The token cache is being invalidate because project f6cea9baaf234f52ac4f57961662f474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:30.187828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:30.188489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6ad88c90-98eb-4264-bdf2-700de843a12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:30.190036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1298/2600] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:47:29 2022] DELETE /identity/v3/projects/f6cea9baaf234f52ac4f57961662f474 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:30.195410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fa36-ed24-4782-bfcb-cbdbdf7cc23d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.195939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fa36-ed24-4782-bfcb-cbdbdf7cc23d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.196035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fa36-ed24-4782-bfcb-cbdbdf7cc23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.213797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-b139fa36-ed24-4782-bfcb-cbdbdf7cc23d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:30.214918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-b139fa36-ed24-4782-bfcb-cbdbdf7cc23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:30.320606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1303/2601] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:30.321869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd17be-862a-43e3-9e1f-f879c1fbe2dc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.322166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd17be-862a-43e3-9e1f-f879c1fbe2dc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.322449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd17be-862a-43e3-9e1f-f879c1fbe2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.344744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8fdd17be-862a-43e3-9e1f-f879c1fbe2dc None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:30.354560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8fdd17be-862a-43e3-9e1f-f879c1fbe2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:30.356236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1299/2602] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:47:30.360334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139fa36-ed24-4782-bfcb-cbdbdf7cc23d None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:30.370932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139fa36-ed24-4782-bfcb-cbdbdf7cc23d None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:30.376844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:30.377730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.378110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.378388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.379120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:47:30.379425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:30.381733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:30.396799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1304/2603] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:47:30.401299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd17be-862a-43e3-9e1f-f879c1fbe2dc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:30.411803 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd17be-862a-43e3-9e1f-f879c1fbe2dc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:30.419423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537e82-23e8-495b-89b2-ee4ad343aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:30.420614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537e82-23e8-495b-89b2-ee4ad343aa07 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.420907 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537e82-23e8-495b-89b2-ee4ad343aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.421185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537e82-23e8-495b-89b2-ee4ad343aa07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.421884 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54537e82-23e8-495b-89b2-ee4ad343aa07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:30.423838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54537e82-23e8-495b-89b2-ee4ad343aa07 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:30.516403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1300/2604] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:30 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:30.521702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:30.527701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:30.536349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833ffc5-d0d8-43d3-88d1-755db1342f7f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:30.603538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e014d6d-00ae-4b4d-a004-7072e1f0fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:30.604375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014d6d-00ae-4b4d-a004-7072e1f0fc52 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.604727 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014d6d-00ae-4b4d-a004-7072e1f0fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.605009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014d6d-00ae-4b4d-a004-7072e1f0fc52 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.605708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e014d6d-00ae-4b4d-a004-7072e1f0fc52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:30.607653 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e014d6d-00ae-4b4d-a004-7072e1f0fc52 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:30.675358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1305/2605] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:30 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:30.679894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537e82-23e8-495b-89b2-ee4ad343aa07 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:30.691757 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537e82-23e8-495b-89b2-ee4ad343aa07 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:30.700931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269b63e-2fd0-436b-99b3-da707f874bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:30.703334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269b63e-2fd0-436b-99b3-da707f874bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.703334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269b63e-2fd0-436b-99b3-da707f874bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.703334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269b63e-2fd0-436b-99b3-da707f874bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.703334 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269b63e-2fd0-436b-99b3-da707f874bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:30.704485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269b63e-2fd0-436b-99b3-da707f874bcd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:30.719444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1301/2606] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:47:30.721294 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e014d6d-00ae-4b4d-a004-7072e1f0fc52 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:30.746453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e014d6d-00ae-4b4d-a004-7072e1f0fc52 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:30.758167 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:30.759057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.759593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.759877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.760709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:30.762282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:30.775337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1306/2607] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:30.779252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269b63e-2fd0-436b-99b3-da707f874bcd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:30.789926 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269b63e-2fd0-436b-99b3-da707f874bcd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:30.795579 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed7b1-e462-4147-83c0-f9eed79ca285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:30.796750 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed7b1-e462-4147-83c0-f9eed79ca285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.797037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed7b1-e462-4147-83c0-f9eed79ca285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.797310 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed7b1-e462-4147-83c0-f9eed79ca285 admin admin] PATH_INFO: `/v3/projects/41c66e9095994ebd9bb124df443cf3c6/users/59b827f140214c9cb5bafa22b799eb18/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.814170 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ed7b1-e462-4147-83c0-f9eed79ca285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c66e9095994ebd9bb124df443cf3c6, user_id=59b827f140214c9cb5bafa22b799eb18, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:30.815632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ed7b1-e462-4147-83c0-f9eed79ca285 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:30.869116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:30.871077 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:30.919709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1302/2608] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:30 2022] PUT /identity/v3/projects/41c66e9095994ebd9bb124df443cf3c6/users/59b827f140214c9cb5bafa22b799eb18/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:30.930420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd741be7-dfc2-4e5b-9a3a-5173d73e8de5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:30.930851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd741be7-dfc2-4e5b-9a3a-5173d73e8de5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:30.931229 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd741be7-dfc2-4e5b-9a3a-5173d73e8de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:30.953764 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf82911-b4ec-4dfe-830e-1c59733f6495 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:30.957460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dd741be7-dfc2-4e5b-9a3a-5173d73e8de5 None None] MFA Rules not processed for user `59b827f140214c9cb5bafa22b799eb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:30.958716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd741be7-dfc2-4e5b-9a3a-5173d73e8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:31.024149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:31.024804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:31.025087 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:31.025402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:31.027281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:31.032542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1303/2609] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:47:31.036429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd741be7-dfc2-4e5b-9a3a-5173d73e8de5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:31.036429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd741be7-dfc2-4e5b-9a3a-5173d73e8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:31.040859 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:31.042637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:31.053663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1307/2610] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:47:31.056138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:31.057928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:31.072796 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:31.110273 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd741be7-dfc2-4e5b-9a3a-5173d73e8de5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:31.115171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:31.116075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:31.116357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:31.116630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] PATH_INFO: `/v3/users/2ff9f53decbc44ce9166f6c841e8ea02` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:31.117894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff9f53decbc44ce9166f6c841e8ea02)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:31.119844 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:31.120123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda33b-46bc-4071-9a96-c5376b7612d9 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:31.121517 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:31.123924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028724-6c2a-49e7-840c-1061df08e9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:31.124607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028724-6c2a-49e7-840c-1061df08e9bc service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:31.124884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028724-6c2a-49e7-840c-1061df08e9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:31.125157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028724-6c2a-49e7-840c-1061df08e9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:31.133735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf028724-6c2a-49e7-840c-1061df08e9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:31.135164 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf028724-6c2a-49e7-840c-1061df08e9bc service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:31.144557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1308/2611] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:31.334327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff9f53decbc44ce9166f6c841e8ea02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:31.410217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff9f53decbc44ce9166f6c841e8ea02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:31.423816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff9f53decbc44ce9166f6c841e8ea02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:31.424539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff9f53decbc44ce9166f6c841e8ea02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:31.431347 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff9f53decbc44ce9166f6c841e8ea02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:31.437302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1304/2612] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:47:31 2022] DELETE /identity/v3/users/2ff9f53decbc44ce9166f6c841e8ea02 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:31.692071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028724-6c2a-49e7-840c-1061df08e9bc service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:31.704096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028724-6c2a-49e7-840c-1061df08e9bc service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:31.762732 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:31.763597 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:31.763878 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:31.764192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] PATH_INFO: `/v3/projects/5075d84d5c6f4ad89f397c8b563e17df` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:31.765607 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5075d84d5c6f4ad89f397c8b563e17df)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:31.767494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:31.831328 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:31.836017 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:31.898179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d481d-4028-426b-ae39-be4114413b99 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:31.910342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5075d84d5c6f4ad89f397c8b563e17df', 'request_id': 'req-6c7391cf-5c0a-42bc-8157-5738b499e8e6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:31.923081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5075d84d5c6f4ad89f397c8b563e17df', 'request_id': 'req-6c7391cf-5c0a-42bc-8157-5738b499e8e6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:31.930856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5075d84d5c6f4ad89f397c8b563e17df', 'request_id': 'req-6c7391cf-5c0a-42bc-8157-5738b499e8e6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:31.955673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef676a-9942-443d-af89-a6d850c60fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:31.956363 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef676a-9942-443d-af89-a6d850c60fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:31.956644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef676a-9942-443d-af89-a6d850c60fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:31.956969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef676a-9942-443d-af89-a6d850c60fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:31.958787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7bef676a-9942-443d-af89-a6d850c60fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:32.005620 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] The token cache is being invalidate because project 5075d84d5c6f4ad89f397c8b563e17df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:32.005914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:32.006660 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-6c7391cf-5c0a-42bc-8157-5738b499e8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:32.008239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1309/2613] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:47:31 2022] DELETE /identity/v3/projects/5075d84d5c6f4ad89f397c8b563e17df => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:32.008454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:32.012941 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d29c73-9172-4709-8d81-c6ef3d945858 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.013237 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d29c73-9172-4709-8d81-c6ef3d945858 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.013641 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d29c73-9172-4709-8d81-c6ef3d945858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.020109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef676a-9942-443d-af89-a6d850c60fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:32.021578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef676a-9942-443d-af89-a6d850c60fd1 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:32.030610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1305/2614] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:32.032636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-46d29c73-9172-4709-8d81-c6ef3d945858 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:32.033847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-46d29c73-9172-4709-8d81-c6ef3d945858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:32.079470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:32.098715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1310/2615] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:47:32.106843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437c6e-24c3-4a5d-a3b6-c1e6db518db2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.107133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437c6e-24c3-4a5d-a3b6-c1e6db518db2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.107592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3437c6e-24c3-4a5d-a3b6-c1e6db518db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.127400 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b3437c6e-24c3-4a5d-a3b6-c1e6db518db2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:32.128644 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b3437c6e-24c3-4a5d-a3b6-c1e6db518db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:32.137319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1306/2616] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:32.143757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d29c73-9172-4709-8d81-c6ef3d945858 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:32.153464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d29c73-9172-4709-8d81-c6ef3d945858 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:32.158610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:32.159538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.160255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.160645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.161522 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:47:32.161904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:32.163554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:32.175394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1311/2617] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:47:32.180244 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3437c6e-24c3-4a5d-a3b6-c1e6db518db2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:32.189319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3437c6e-24c3-4a5d-a3b6-c1e6db518db2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:32.194755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40fc90-3409-47ae-8bd6-b39cfcbc851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:32.195423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40fc90-3409-47ae-8bd6-b39cfcbc851b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.198282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40fc90-3409-47ae-8bd6-b39cfcbc851b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.198282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40fc90-3409-47ae-8bd6-b39cfcbc851b admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.198282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40fc90-3409-47ae-8bd6-b39cfcbc851b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:32.198864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40fc90-3409-47ae-8bd6-b39cfcbc851b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:32.281508 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1307/2618] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:32 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:32.285583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:32.296281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935ee6-a2dc-4684-9c26-1f2bae8764e1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:32.357990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc1841-14fe-4659-80f0-0d014cb3dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:32.357990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc1841-14fe-4659-80f0-0d014cb3dc0d admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.357990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc1841-14fe-4659-80f0-0d014cb3dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.358406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc1841-14fe-4659-80f0-0d014cb3dc0d admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.358788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc1841-14fe-4659-80f0-0d014cb3dc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:32.361058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc1841-14fe-4659-80f0-0d014cb3dc0d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:32.462338 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1312/2619] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:32 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:32.466533 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40fc90-3409-47ae-8bd6-b39cfcbc851b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:32.478015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40fc90-3409-47ae-8bd6-b39cfcbc851b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:32.482705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac5e2-4e16-473f-a4f3-d760da4558d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:32.483357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac5e2-4e16-473f-a4f3-d760da4558d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.483643 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac5e2-4e16-473f-a4f3-d760da4558d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.483927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac5e2-4e16-473f-a4f3-d760da4558d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.484727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac5e2-4e16-473f-a4f3-d760da4558d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:32.486338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac5e2-4e16-473f-a4f3-d760da4558d6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:32.497653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1308/2620] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:32.501911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc1841-14fe-4659-80f0-0d014cb3dc0d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:32.511814 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc1841-14fe-4659-80f0-0d014cb3dc0d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:32.516813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb6ada-675a-42ce-a7e3-964a6175c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:32.517463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6ada-675a-42ce-a7e3-964a6175c6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.517811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6ada-675a-42ce-a7e3-964a6175c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.518095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6ada-675a-42ce-a7e3-964a6175c6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.518822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb6ada-675a-42ce-a7e3-964a6175c6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:32.520499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb6ada-675a-42ce-a7e3-964a6175c6fe admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:32.530969 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1313/2621] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:32.540281 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac5e2-4e16-473f-a4f3-d760da4558d6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:32.550577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac5e2-4e16-473f-a4f3-d760da4558d6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:32.556914 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:32.557975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.558503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.558645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] PATH_INFO: `/v3/projects/cfd569e249414edb910f298f70b9218e/users/46f837bc019e4e1a86f63d20a9790c2b/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.576051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd569e249414edb910f298f70b9218e, user_id=46f837bc019e4e1a86f63d20a9790c2b, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:32.578706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:32.657680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1309/2622] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:32 2022] PUT /identity/v3/projects/cfd569e249414edb910f298f70b9218e/users/46f837bc019e4e1a86f63d20a9790c2b/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:32.669097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677936-1756-40fc-b7f1-50383012b988 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.669489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677936-1756-40fc-b7f1-50383012b988 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.669846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677936-1756-40fc-b7f1-50383012b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.697155 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8f677936-1756-40fc-b7f1-50383012b988 None None] MFA Rules not processed for user `46f837bc019e4e1a86f63d20a9790c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:32.698530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8f677936-1756-40fc-b7f1-50383012b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:32.778631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1314/2623] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:32.790938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:32.792682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:32.867848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf69091-a731-421a-92e6-cc8e35eab94b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:32.873729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:32.874315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:32.874623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:32.874893 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:32.883445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:32.885046 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:32.896295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1310/2624] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:41.753591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677936-1756-40fc-b7f1-50383012b988 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:41.755079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8f677936-1756-40fc-b7f1-50383012b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:41.801291 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:41.813127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677936-1756-40fc-b7f1-50383012b988 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:41.816784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:41.817421 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:41.817702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:41.817995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:41.819706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:41.882923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:41.884456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:41.894175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1315/2625] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:42.319403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:42.321631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:42.339205 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:42.341034 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1416-2899-4254-8b63-9788934007f6 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:42.346910 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0fc3-099e-4278-a0b7-75d748323adb service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:42.348121 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:42.348927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:42.349338 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:42.349617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] PATH_INFO: `/v3/users/59b827f140214c9cb5bafa22b799eb18` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:42.351107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b827f140214c9cb5bafa22b799eb18)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:42.351569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:42.352504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:42.352791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:42.353063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] PATH_INFO: `/v3/users/46f837bc019e4e1a86f63d20a9790c2b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:42.353972 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:42.354265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f837bc019e4e1a86f63d20a9790c2b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:42.356192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:42.544242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f837bc019e4e1a86f63d20a9790c2b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.553364 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f837bc019e4e1a86f63d20a9790c2b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.563602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b827f140214c9cb5bafa22b799eb18'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.616319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f837bc019e4e1a86f63d20a9790c2b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.617037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f837bc019e4e1a86f63d20a9790c2b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.629959 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729a764-62ba-4ab9-b099-108da77c4c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f837bc019e4e1a86f63d20a9790c2b'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.637818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1316/2626] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:47:42 2022] DELETE /identity/v3/users/46f837bc019e4e1a86f63d20a9790c2b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:47:42.641576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fa9b-f132-40ca-bd3f-53688e41a5cf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:42.641869 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fa9b-f132-40ca-bd3f-53688e41a5cf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:42.642144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870fa9b-f132-40ca-bd3f-53688e41a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:42.650733 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b827f140214c9cb5bafa22b799eb18'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.660373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:42.667979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b827f140214c9cb5bafa22b799eb18'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.668535 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-8870fa9b-f132-40ca-bd3f-53688e41a5cf None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:42.668876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b827f140214c9cb5bafa22b799eb18'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.669781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8870fa9b-f132-40ca-bd3f-53688e41a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:42.677222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7c39b8ef-2538-49e4-8b8e-c7d408707a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b827f140214c9cb5bafa22b799eb18'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:42.688116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1311/2627] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:47:42 2022] DELETE /identity/v3/users/59b827f140214c9cb5bafa22b799eb18 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:42.690154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634463c0-9970-4059-988a-787ed76ce6df None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:42.690449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634463c0-9970-4059-988a-787ed76ce6df None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:42.690740 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634463c0-9970-4059-988a-787ed76ce6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:42.710939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-634463c0-9970-4059-988a-787ed76ce6df None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:42.712324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-634463c0-9970-4059-988a-787ed76ce6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:42.744335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1317/2628] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:47:42.753687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870fa9b-f132-40ca-bd3f-53688e41a5cf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:42.755811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-8870fa9b-f132-40ca-bd3f-53688e41a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:42.765361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:42.773436 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1312/2629] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:42.782775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634463c0-9970-4059-988a-787ed76ce6df None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:42.784133 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-634463c0-9970-4059-988a-787ed76ce6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:42.839629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870fa9b-f132-40ca-bd3f-53688e41a5cf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:42.851140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634463c0-9970-4059-988a-787ed76ce6df None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:42.860385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:42.861195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:42.861578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:42.861957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:42.874577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:42.876321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:42.902464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1313/2630] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:47:42.905392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:42.906176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:42.906564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:42.906937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:42.924290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:42.925775 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:42.938754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1318/2631] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:47:43.560390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:43.564120 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:43.574754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cbea6-daff-4326-a976-97248d470aa8 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:43.580115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:43.580978 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:43.581254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:43.581524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] PATH_INFO: `/v3/projects/41c66e9095994ebd9bb124df443cf3c6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:43.582727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c66e9095994ebd9bb124df443cf3c6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:43.584662 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:43.663866 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:43.666129 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:43.683070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf77ee-787a-41a7-8d46-6b7f4a56dee7 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:43.700221 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:43.701099 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:43.701386 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:43.701661 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] PATH_INFO: `/v3/projects/cfd569e249414edb910f298f70b9218e` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:43.704479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd569e249414edb910f298f70b9218e)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:43.710287 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:43.710636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c66e9095994ebd9bb124df443cf3c6', 'request_id': 'req-28df9866-9bf8-496f-bca8-05b5768c7da2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.720880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c66e9095994ebd9bb124df443cf3c6', 'request_id': 'req-28df9866-9bf8-496f-bca8-05b5768c7da2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.730922 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c66e9095994ebd9bb124df443cf3c6', 'request_id': 'req-28df9866-9bf8-496f-bca8-05b5768c7da2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.821909 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] The token cache is being invalidate because project 41c66e9095994ebd9bb124df443cf3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:43.821909 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.821909 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-28df9866-9bf8-496f-bca8-05b5768c7da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.821909 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1314/2632] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:47:43 2022] DELETE /identity/v3/projects/41c66e9095994ebd9bb124df443cf3c6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:43.826322 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d5f1-666d-436e-994d-3356420240f2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:43.826705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d5f1-666d-436e-994d-3356420240f2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:43.834847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d5f1-666d-436e-994d-3356420240f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:43.879012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7ea5d5f1-666d-436e-994d-3356420240f2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:43.881774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7ea5d5f1-666d-436e-994d-3356420240f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:43.886116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:43.890310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd569e249414edb910f298f70b9218e', 'request_id': 'req-88a22961-5c8c-4cde-8215-b6c63119c46a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.899011 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd569e249414edb910f298f70b9218e', 'request_id': 'req-88a22961-5c8c-4cde-8215-b6c63119c46a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.906631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd569e249414edb910f298f70b9218e', 'request_id': 'req-88a22961-5c8c-4cde-8215-b6c63119c46a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.954874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1315/2633] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:43.962780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365d82-70ed-4565-9639-a8867966f57e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:43.963149 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365d82-70ed-4565-9639-a8867966f57e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:43.963429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e365d82-70ed-4565-9639-a8867966f57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:43.966985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] The token cache is being invalidate because project cfd569e249414edb910f298f70b9218e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:43.973721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.973721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-88a22961-5c8c-4cde-8215-b6c63119c46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:43.973721 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1319/2634] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:47:43 2022] DELETE /identity/v3/projects/cfd569e249414edb910f298f70b9218e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:43.976262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6d2ba-107e-443d-a81f-a0fb4101f824 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:43.977420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6d2ba-107e-443d-a81f-a0fb4101f824 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:43.977905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6d2ba-107e-443d-a81f-a0fb4101f824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:43.983278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2e365d82-70ed-4565-9639-a8867966f57e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:43.984498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2e365d82-70ed-4565-9639-a8867966f57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:43.993454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1316/2635] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:47:43.997562 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e365d82-70ed-4565-9639-a8867966f57e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:43.998484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c5a6d2ba-107e-443d-a81f-a0fb4101f824 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:43.999724 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c5a6d2ba-107e-443d-a81f-a0fb4101f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:44.007406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e365d82-70ed-4565-9639-a8867966f57e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.008577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1320/2636] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:44.012257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.012911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.013188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.013460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.014179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:47:44.014482 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.016734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.017536 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e3c4d-5efe-49c8-bd9f-123214ac0f69 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.017832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e3c4d-5efe-49c8-bd9f-123214ac0f69 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.018114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e3c4d-5efe-49c8-bd9f-123214ac0f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.029746 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1317/2637] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:47:44.034025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.036937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-060e3c4d-5efe-49c8-bd9f-123214ac0f69 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:44.038202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-060e3c4d-5efe-49c8-bd9f-123214ac0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:44.044786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62879ec-61ae-433b-9d4e-e7be0e0bbdcf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.047127 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1321/2638] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:47:44.049840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba732b-52e3-438b-88e7-4e67118f9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.050614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba732b-52e3-438b-88e7-4e67118f9670 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.050945 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba732b-52e3-438b-88e7-4e67118f9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.051190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e3c4d-5efe-49c8-bd9f-123214ac0f69 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.051330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba732b-52e3-438b-88e7-4e67118f9670 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.051900 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba732b-52e3-438b-88e7-4e67118f9670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.058290 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba732b-52e3-438b-88e7-4e67118f9670 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.060915 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e3c4d-5efe-49c8-bd9f-123214ac0f69 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.065580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.066278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.066568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.066846 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.067586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:47:44.067884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.069579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.081140 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1322/2639] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:47:44.085261 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.094755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eca567-4c92-4f7a-89b7-11bcb9110bd7 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.099399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05d179-bb35-4d96-9aa0-ff8726a7e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.100048 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05d179-bb35-4d96-9aa0-ff8726a7e9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.100334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05d179-bb35-4d96-9aa0-ff8726a7e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.100613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05d179-bb35-4d96-9aa0-ff8726a7e9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.101286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05d179-bb35-4d96-9aa0-ff8726a7e9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.103683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05d179-bb35-4d96-9aa0-ff8726a7e9fd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.168179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1318/2640] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:47:44.172210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba732b-52e3-438b-88e7-4e67118f9670 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.223029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:44.231978 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1323/2641] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:47:44.238301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba732b-52e3-438b-88e7-4e67118f9670 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.239801 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05d179-bb35-4d96-9aa0-ff8726a7e9fd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.310107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373c7e-c58d-4981-b674-be3d47657da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.311059 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373c7e-c58d-4981-b674-be3d47657da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.311389 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373c7e-c58d-4981-b674-be3d47657da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.311667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373c7e-c58d-4981-b674-be3d47657da2 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.312588 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373c7e-c58d-4981-b674-be3d47657da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.315482 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373c7e-c58d-4981-b674-be3d47657da2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.326436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05d179-bb35-4d96-9aa0-ff8726a7e9fd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.326436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326add3-8fa0-46ff-9469-a7e188b7214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.326436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326add3-8fa0-46ff-9469-a7e188b7214e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.327128 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326add3-8fa0-46ff-9469-a7e188b7214e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.327415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326add3-8fa0-46ff-9469-a7e188b7214e admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.328199 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326add3-8fa0-46ff-9469-a7e188b7214e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.331315 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326add3-8fa0-46ff-9469-a7e188b7214e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.403567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1319/2642] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:47:44.404711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373c7e-c58d-4981-b674-be3d47657da2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.419512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373c7e-c58d-4981-b674-be3d47657da2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.423060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1324/2643] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:44.427748 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:44.433232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326add3-8fa0-46ff-9469-a7e188b7214e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.436329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0cfc-be36-491b-921f-410f1501f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.437012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0cfc-be36-491b-921f-410f1501f1db admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.437295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0cfc-be36-491b-921f-410f1501f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.437577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0cfc-be36-491b-921f-410f1501f1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.438559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb0cfc-be36-491b-921f-410f1501f1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.440206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb0cfc-be36-491b-921f-410f1501f1db admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.449333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326add3-8fa0-46ff-9469-a7e188b7214e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.454437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1320/2644] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:47:44.455557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0cfc-be36-491b-921f-410f1501f1db admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.457554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4faa0-2a83-4eef-aeb5-f1198c2fc463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.458788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4faa0-2a83-4eef-aeb5-f1198c2fc463 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.459126 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4faa0-2a83-4eef-aeb5-f1198c2fc463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.459457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4faa0-2a83-4eef-aeb5-f1198c2fc463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.460227 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4faa0-2a83-4eef-aeb5-f1198c2fc463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.462563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4faa0-2a83-4eef-aeb5-f1198c2fc463 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.466937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0cfc-be36-491b-921f-410f1501f1db admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.471737 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd63f-9845-4786-839e-684176cee07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.472887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd63f-9845-4786-839e-684176cee07c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.473241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd63f-9845-4786-839e-684176cee07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.473584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd63f-9845-4786-839e-684176cee07c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.474311 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd63f-9845-4786-839e-684176cee07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.476023 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd63f-9845-4786-839e-684176cee07c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.478537 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1325/2645] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:47:44.479425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4faa0-2a83-4eef-aeb5-f1198c2fc463 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.487132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1321/2646] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:44.491360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd63f-9845-4786-839e-684176cee07c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.493904 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4faa0-2a83-4eef-aeb5-f1198c2fc463 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.502596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a71ab7-dab1-4316-8d49-d0c603277782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.502798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd63f-9845-4786-839e-684176cee07c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.503454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a71ab7-dab1-4316-8d49-d0c603277782 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.503788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a71ab7-dab1-4316-8d49-d0c603277782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.504163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a71ab7-dab1-4316-8d49-d0c603277782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.504971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a71ab7-dab1-4316-8d49-d0c603277782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.507045 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a71ab7-dab1-4316-8d49-d0c603277782 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.509813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8cde1-5952-4dde-a05a-bdc1bf1e683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.511259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cde1-5952-4dde-a05a-bdc1bf1e683d admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.518534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cde1-5952-4dde-a05a-bdc1bf1e683d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.518534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8cde1-5952-4dde-a05a-bdc1bf1e683d admin admin] PATH_INFO: `/v3/projects/c0de2588b13e487a91aaf1ad7ea7bd6f/users/513b7a90f9fe4d91aea642eae12b3753/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.522093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1326/2647] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:44.523569 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a71ab7-dab1-4316-8d49-d0c603277782 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.532873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8cde1-5952-4dde-a05a-bdc1bf1e683d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0de2588b13e487a91aaf1ad7ea7bd6f, user_id=513b7a90f9fe4d91aea642eae12b3753, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.536408 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a71ab7-dab1-4316-8d49-d0c603277782 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.537630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8cde1-5952-4dde-a05a-bdc1bf1e683d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.541664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0fb84-1716-4675-84fa-58b381e4b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.542635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0fb84-1716-4675-84fa-58b381e4b100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.542987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0fb84-1716-4675-84fa-58b381e4b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.543379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0fb84-1716-4675-84fa-58b381e4b100 admin admin] PATH_INFO: `/v3/projects/cbc9245649ba4ae49020e112f0628368/users/24f4e0c82e6146ce9115131603ee2295/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.560973 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0fb84-1716-4675-84fa-58b381e4b100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc9245649ba4ae49020e112f0628368, user_id=24f4e0c82e6146ce9115131603ee2295, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.563736 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0fb84-1716-4675-84fa-58b381e4b100 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.594161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1322/2648] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:44 2022] PUT /identity/v3/projects/c0de2588b13e487a91aaf1ad7ea7bd6f/users/513b7a90f9fe4d91aea642eae12b3753/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:44.599336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d797-3f72-497f-a694-eb4e1cfe7aec None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.599627 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d797-3f72-497f-a694-eb4e1cfe7aec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.599929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d797-3f72-497f-a694-eb4e1cfe7aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.617427 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3a74d797-3f72-497f-a694-eb4e1cfe7aec None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:44.618641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a74d797-3f72-497f-a694-eb4e1cfe7aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:44.662520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1327/2649] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:44 2022] PUT /identity/v3/projects/cbc9245649ba4ae49020e112f0628368/users/24f4e0c82e6146ce9115131603ee2295/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:44.664145 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39704ffd-2469-45c2-bb56-800a2c7c5452 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.664435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39704ffd-2469-45c2-bb56-800a2c7c5452 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.664719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39704ffd-2469-45c2-bb56-800a2c7c5452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.693090 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1323/2650] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:47:44.695826 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-39704ffd-2469-45c2-bb56-800a2c7c5452 None None] MFA Rules not processed for user `24f4e0c82e6146ce9115131603ee2295`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:44.697197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-39704ffd-2469-45c2-bb56-800a2c7c5452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:44.704027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74d797-3f72-497f-a694-eb4e1cfe7aec None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.705448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a74d797-3f72-497f-a694-eb4e1cfe7aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:44.779526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1328/2651] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:44.783865 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39704ffd-2469-45c2-bb56-800a2c7c5452 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:44.784329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74d797-3f72-497f-a694-eb4e1cfe7aec None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.819495 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:44.847988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bdd5a-2e65-4710-b057-0d394543bc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.848937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bdd5a-2e65-4710-b057-0d394543bc06 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.850199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bdd5a-2e65-4710-b057-0d394543bc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.850729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bdd5a-2e65-4710-b057-0d394543bc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.854394 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39704ffd-2469-45c2-bb56-800a2c7c5452 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:44.859384 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b95dc0-f58f-40cd-b869-940d5f7d170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:44.864188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b95dc0-f58f-40cd-b869-940d5f7d170c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:44.864188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b95dc0-f58f-40cd-b869-940d5f7d170c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:44.864188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b95dc0-f58f-40cd-b869-940d5f7d170c admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:44.864188 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b95dc0-f58f-40cd-b869-940d5f7d170c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.864586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bdd5a-2e65-4710-b057-0d394543bc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:44.865377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b95dc0-f58f-40cd-b869-940d5f7d170c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.865506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bdd5a-2e65-4710-b057-0d394543bc06 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:44.878571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1324/2652] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:44.985708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1329/2653] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:47:44.990319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bdd5a-2e65-4710-b057-0d394543bc06 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:45.014597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bdd5a-2e65-4710-b057-0d394543bc06 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:45.042968 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:45.115072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce28548-971a-46c6-82ed-2a7ed40a420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:45.115826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce28548-971a-46c6-82ed-2a7ed40a420a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:45.116137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce28548-971a-46c6-82ed-2a7ed40a420a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:45.116412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce28548-971a-46c6-82ed-2a7ed40a420a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:45.117782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce28548-971a-46c6-82ed-2a7ed40a420a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:45.119873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce28548-971a-46c6-82ed-2a7ed40a420a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:45.214142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1325/2654] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:44 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:47:45.215577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b95dc0-f58f-40cd-b869-940d5f7d170c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:45.229631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b95dc0-f58f-40cd-b869-940d5f7d170c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:45.241476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd265-7c57-4a38-a3c4-6ce1422247ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:45.241476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd265-7c57-4a38-a3c4-6ce1422247ba admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:45.241476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd265-7c57-4a38-a3c4-6ce1422247ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:45.241476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd265-7c57-4a38-a3c4-6ce1422247ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:45.242741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dd265-7c57-4a38-a3c4-6ce1422247ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:45.242966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dd265-7c57-4a38-a3c4-6ce1422247ba admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:45.256510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1330/2655] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:45.259557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce28548-971a-46c6-82ed-2a7ed40a420a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:45.271265 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce28548-971a-46c6-82ed-2a7ed40a420a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:45.276887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16921c25-2bf6-410e-8ff2-9c75b4b51d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:45.277974 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921c25-2bf6-410e-8ff2-9c75b4b51d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:45.282654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921c25-2bf6-410e-8ff2-9c75b4b51d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:45.282654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921c25-2bf6-410e-8ff2-9c75b4b51d1a admin admin] PATH_INFO: `/v3/projects/e85db119ff8e4d44b1e2afe4ec2a7f1c/users/67b9502711ad49cdb300aa32e2881253/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:45.303000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16921c25-2bf6-410e-8ff2-9c75b4b51d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85db119ff8e4d44b1e2afe4ec2a7f1c, user_id=67b9502711ad49cdb300aa32e2881253, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:45.306399 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16921c25-2bf6-410e-8ff2-9c75b4b51d1a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:45.401404 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1326/2656] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:45 2022] PUT /identity/v3/projects/e85db119ff8e4d44b1e2afe4ec2a7f1c/users/67b9502711ad49cdb300aa32e2881253/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:45.405927 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd265-7c57-4a38-a3c4-6ce1422247ba admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:45.416644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd265-7c57-4a38-a3c4-6ce1422247ba admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:45.475387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0e658-fe26-4ad4-ad25-24b5cae37873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:45.476136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e658-fe26-4ad4-ad25-24b5cae37873 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:45.476500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e658-fe26-4ad4-ad25-24b5cae37873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:45.477350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e658-fe26-4ad4-ad25-24b5cae37873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:45.478158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0e658-fe26-4ad4-ad25-24b5cae37873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:45.479813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0e658-fe26-4ad4-ad25-24b5cae37873 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:45.493009 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1331/2657] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:45.496030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16921c25-2bf6-410e-8ff2-9c75b4b51d1a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:45.510808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16921c25-2bf6-410e-8ff2-9c75b4b51d1a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:45.516707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:45.517744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:45.518030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:45.518556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] PATH_INFO: `/v3/projects/e85db119ff8e4d44b1e2afe4ec2a7f1c/users/67b9502711ad49cdb300aa32e2881253/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:45.521142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85db119ff8e4d44b1e2afe4ec2a7f1c, user_id=67b9502711ad49cdb300aa32e2881253, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:45.525894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:45.538630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1327/2658] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:45 2022] PUT /identity/v3/projects/e85db119ff8e4d44b1e2afe4ec2a7f1c/users/67b9502711ad49cdb300aa32e2881253/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:45.549713 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fabd-97fa-40c6-80c3-22554995f50e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:45.550006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fabd-97fa-40c6-80c3-22554995f50e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:45.550284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205fabd-97fa-40c6-80c3-22554995f50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:45.578403 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-7205fabd-97fa-40c6-80c3-22554995f50e None None] MFA Rules not processed for user `67b9502711ad49cdb300aa32e2881253`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:45.579689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-7205fabd-97fa-40c6-80c3-22554995f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:45.656616 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1332/2659] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:45.668117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:45.669835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:45.731119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659317c3-9cc4-4755-9193-a4fa27f14789 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:45.735952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720249b-95ac-48ec-895f-123fb38eab9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:45.735952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720249b-95ac-48ec-895f-123fb38eab9b service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:45.735952 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720249b-95ac-48ec-895f-123fb38eab9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:45.736283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720249b-95ac-48ec-895f-123fb38eab9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:45.746188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720249b-95ac-48ec-895f-123fb38eab9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:45.747560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720249b-95ac-48ec-895f-123fb38eab9b service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:45.758082 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1328/2660] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:45.916701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205fabd-97fa-40c6-80c3-22554995f50e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:45.928158 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205fabd-97fa-40c6-80c3-22554995f50e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:45.932037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:45.932790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:45.933143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:45.933491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:45.968640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:46.007073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:46.009314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:46.019361 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1333/2661] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:46.247108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e4f2-a646-4f33-8dff-7f16d719816e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:46.249735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e4f2-a646-4f33-8dff-7f16d719816e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:46.249735 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e4f2-a646-4f33-8dff-7f16d719816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:46.278563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8236e4f2-a646-4f33-8dff-7f16d719816e None None] MFA Rules not processed for user `513b7a90f9fe4d91aea642eae12b3753`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:46.279818 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8236e4f2-a646-4f33-8dff-7f16d719816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:46.355736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1329/2662] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:46.366762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:46.368300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:46.379523 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71065371-6159-4bf2-9262-9d8afb263ce4 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:46.383703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d93e5-949f-495f-9a7f-58a817a55d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:46.384397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d93e5-949f-495f-9a7f-58a817a55d4e service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:46.384739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d93e5-949f-495f-9a7f-58a817a55d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:46.385014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d93e5-949f-495f-9a7f-58a817a55d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:46.394966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d93e5-949f-495f-9a7f-58a817a55d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:46.396548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d93e5-949f-495f-9a7f-58a817a55d4e service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:46.406273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1334/2663] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:48.117730 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55b09-c5eb-436d-a682-96785360c7d5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:48.118260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55b09-c5eb-436d-a682-96785360c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:48.118260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55b09-c5eb-436d-a682-96785360c7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:48.124222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:48.136505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-afb55b09-c5eb-436d-a682-96785360c7d5 None None] MFA Rules not processed for user `513b7a90f9fe4d91aea642eae12b3753`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:48.138224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-afb55b09-c5eb-436d-a682-96785360c7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:48.144699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1330/2664] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:49.143383 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d93e5-949f-495f-9a7f-58a817a55d4e service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:49.236719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d93e5-949f-495f-9a7f-58a817a55d4e service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:49.243354 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:49.244738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:49.245148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:49.245490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] PATH_INFO: `/v3/users/24f4e0c82e6146ce9115131603ee2295` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:49.248470 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f4e0c82e6146ce9115131603ee2295)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:49.250593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:49.476561 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f4e0c82e6146ce9115131603ee2295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:49.483990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f4e0c82e6146ce9115131603ee2295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:49.581890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f4e0c82e6146ce9115131603ee2295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:49.585738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f4e0c82e6146ce9115131603ee2295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:49.598854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f4e0c82e6146ce9115131603ee2295'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:49.606681 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1335/2665] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:47:49 2022] DELETE /identity/v3/users/24f4e0c82e6146ce9115131603ee2295 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:49.611439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5665-6106-478b-a86e-ebb9a68c680e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:49.617608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5665-6106-478b-a86e-ebb9a68c680e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:49.617608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5665-6106-478b-a86e-ebb9a68c680e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:49.630589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-11ba5665-6106-478b-a86e-ebb9a68c680e None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:49.631798 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11ba5665-6106-478b-a86e-ebb9a68c680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:49.703224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1331/2666] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:49.716389 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:49.717957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:49.767982 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:49.798022 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca97f9-47d8-4999-b88e-0dc32794a78a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:49.802247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:49.802905 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:49.811839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:49.811839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:49.817786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:49.819499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:49.832447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1336/2667] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:49.937201 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba5665-6106-478b-a86e-ebb9a68c680e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:49.938870 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11ba5665-6106-478b-a86e-ebb9a68c680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:49.956015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba5665-6106-478b-a86e-ebb9a68c680e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:49.962898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:49.963767 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:49.964107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:49.964383 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] PATH_INFO: `/v3/users/7488c1659ed64e9bb4c28a7284578d29` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:49.965656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=7488c1659ed64e9bb4c28a7284578d29)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:49.967475 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:50.200880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7488c1659ed64e9bb4c28a7284578d29'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.330032 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7488c1659ed64e9bb4c28a7284578d29'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.331830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:50.333359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:50.343601 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7488c1659ed64e9bb4c28a7284578d29'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.344378 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7488c1659ed64e9bb4c28a7284578d29'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.348207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be926f-870d-4993-a35f-f9b010ff5b4d service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:50.352057 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7488c1659ed64e9bb4c28a7284578d29'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.353889 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:50.357690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:50.357690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:50.357690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] PATH_INFO: `/v3/projects/cbc9245649ba4ae49020e112f0628368` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:50.357690 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc9245649ba4ae49020e112f0628368)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:50.359314 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1332/2668] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:47:49 2022] DELETE /identity/v3/users/7488c1659ed64e9bb4c28a7284578d29 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:50.369864 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:50.503437 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc9245649ba4ae49020e112f0628368', 'request_id': 'req-c8f0db62-59ca-455b-8d30-1740acc144ff'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.509387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc9245649ba4ae49020e112f0628368', 'request_id': 'req-c8f0db62-59ca-455b-8d30-1740acc144ff'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.515600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc9245649ba4ae49020e112f0628368', 'request_id': 'req-c8f0db62-59ca-455b-8d30-1740acc144ff'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.587113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] The token cache is being invalidate because project cbc9245649ba4ae49020e112f0628368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:50.587323 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.588541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.590316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1337/2669] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:47:50 2022] DELETE /identity/v3/projects/cbc9245649ba4ae49020e112f0628368 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:50.594183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:50.595548 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:50.606647 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:50.608168 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:50.669673 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd46ca-c410-422a-a5c3-c649ea9b8ded admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:50.674557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:50.675501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:50.679682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:50.679682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] PATH_INFO: `/v3/users/67b9502711ad49cdb300aa32e2881253` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:50.679682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b9502711ad49cdb300aa32e2881253)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:50.679682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:50.682424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0db62-59ca-455b-8d30-1740acc144ff admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:50.687530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:50.688508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:50.688854 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:50.689197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] PATH_INFO: `/v3/projects/4020df94dce44ce6bfe88478e6efa55f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:50.690344 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:50.690487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4020df94dce44ce6bfe88478e6efa55f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:50.692473 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:50.888667 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4020df94dce44ce6bfe88478e6efa55f', 'request_id': 'req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.889729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b9502711ad49cdb300aa32e2881253'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.894763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4020df94dce44ce6bfe88478e6efa55f', 'request_id': 'req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.901657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4020df94dce44ce6bfe88478e6efa55f', 'request_id': 'req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.964631 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b9502711ad49cdb300aa32e2881253'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.978453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b9502711ad49cdb300aa32e2881253'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.979141 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b9502711ad49cdb300aa32e2881253'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.986163 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b9502711ad49cdb300aa32e2881253'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:50.992716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1333/2670] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:47:50 2022] DELETE /identity/v3/users/67b9502711ad49cdb300aa32e2881253 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:51.073662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] The token cache is being invalidate because project 4020df94dce44ce6bfe88478e6efa55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:51.074043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.074874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.076611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1338/2671] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:47:50 2022] DELETE /identity/v3/projects/4020df94dce44ce6bfe88478e6efa55f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:47:51.080547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:51.082031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:51.142577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:51.153847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704986a-75ba-49c1-9184-f437b42f2aae admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:51.158492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:51.159354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:51.159638 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:51.159928 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] PATH_INFO: `/v3/users/69b1e491e65c4c0791623039f3ae4d0d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:51.161260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b1e491e65c4c0791623039f3ae4d0d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:51.163179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:51.355558 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b1e491e65c4c0791623039f3ae4d0d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.435875 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:51.437425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:51.444854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b1e491e65c4c0791623039f3ae4d0d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.461931 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b1e491e65c4c0791623039f3ae4d0d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.462641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b1e491e65c4c0791623039f3ae4d0d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.489222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b1e491e65c4c0791623039f3ae4d0d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.507841 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1334/2672] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:47:51 2022] DELETE /identity/v3/users/69b1e491e65c4c0791623039f3ae4d0d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:51.535074 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64148-0f8a-4108-9e2f-4bcf8ef86a00 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:51.615558 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:51.616636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:51.616917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:51.617799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] PATH_INFO: `/v3/projects/e85db119ff8e4d44b1e2afe4ec2a7f1c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:51.619115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85db119ff8e4d44b1e2afe4ec2a7f1c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:51.621441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:51.714197 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85db119ff8e4d44b1e2afe4ec2a7f1c', 'request_id': 'req-e6a5f7da-ed4b-44d9-a308-bee1c4180073'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.720516 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85db119ff8e4d44b1e2afe4ec2a7f1c', 'request_id': 'req-e6a5f7da-ed4b-44d9-a308-bee1c4180073'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.727538 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85db119ff8e4d44b1e2afe4ec2a7f1c', 'request_id': 'req-e6a5f7da-ed4b-44d9-a308-bee1c4180073'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.790458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:51.792494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] The token cache is being invalidate because project e85db119ff8e4d44b1e2afe4ec2a7f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:51.792802 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:51.793047 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.794057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-e6a5f7da-ed4b-44d9-a308-bee1c4180073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:51.810094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1339/2673] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:47:51 2022] DELETE /identity/v3/projects/e85db119ff8e4d44b1e2afe4ec2a7f1c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:47:51.816131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717bad-8b9e-441d-8b8b-04383b9b0332 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:51.816425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717bad-8b9e-441d-8b8b-04383b9b0332 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:51.816706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717bad-8b9e-441d-8b8b-04383b9b0332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:51.820995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d86ca-df13-400f-bb62-da6095133e00 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:51.833766 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:51.842186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ba717bad-8b9e-441d-8b8b-04383b9b0332 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:51.843508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ba717bad-8b9e-441d-8b8b-04383b9b0332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:51.900744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:51.902051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:51.902501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:51.902779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] PATH_INFO: `/v3/projects/a6d0f38eca6c41eb885bb9bb14d570d8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:51.904010 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d0f38eca6c41eb885bb9bb14d570d8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:51.905925 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:51.915545 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1340/2674] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:51.923382 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0464f-b3df-4355-850f-97ed899196af None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:51.924269 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0464f-b3df-4355-850f-97ed899196af None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:51.924642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0464f-b3df-4355-850f-97ed899196af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:51.927555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:51.946259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-cbe0464f-b3df-4355-850f-97ed899196af None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:51.947575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-cbe0464f-b3df-4355-850f-97ed899196af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:51.955744 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1341/2675] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:51.960004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0464f-b3df-4355-850f-97ed899196af None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:51.969481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0464f-b3df-4355-850f-97ed899196af None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:51.974065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:51.974706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:51.974990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:51.975265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:51.976019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:47:51.977028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:51.978494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:51.990186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1342/2676] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:47:51.994900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:52.004367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21f75-4941-47bc-83af-badca9651f47 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:52.009758 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:52.010456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:52.010743 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:52.011019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:52.011709 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:52.013657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:52.030325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d0f38eca6c41eb885bb9bb14d570d8', 'request_id': 'req-a6903353-347a-4696-b53e-7585e9739409'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:52.035864 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d0f38eca6c41eb885bb9bb14d570d8', 'request_id': 'req-a6903353-347a-4696-b53e-7585e9739409'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:52.045551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d0f38eca6c41eb885bb9bb14d570d8', 'request_id': 'req-a6903353-347a-4696-b53e-7585e9739409'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:52.124614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] The token cache is being invalidate because project a6d0f38eca6c41eb885bb9bb14d570d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:47:52.124911 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:52.126291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:47:52.127229 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1343/2677] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:51 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:47:52.127822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1335/2678] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:47:51 2022] DELETE /identity/v3/projects/a6d0f38eca6c41eb885bb9bb14d570d8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:47:52.131342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:52.133659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:52.209115 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb57a4-cc8f-4113-a63c-acbe81601b7c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:52.215093 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b7e75-9517-4f17-94c1-6f839de6e7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:52.216061 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e75-9517-4f17-94c1-6f839de6e7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:52.216671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e75-9517-4f17-94c1-6f839de6e7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:52.216771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e75-9517-4f17-94c1-6f839de6e7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:52.217665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b7e75-9517-4f17-94c1-6f839de6e7b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:52.219930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b7e75-9517-4f17-94c1-6f839de6e7b9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:52.343395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1344/2679] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:52 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:52.344405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:52.413502 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6903353-347a-4696-b53e-7585e9739409 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:52.418153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae25d8-8cda-47f4-bd75-d357c8baf81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:52.418814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae25d8-8cda-47f4-bd75-d357c8baf81f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:52.419093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae25d8-8cda-47f4-bd75-d357c8baf81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:52.419368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae25d8-8cda-47f4-bd75-d357c8baf81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:52.420125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae25d8-8cda-47f4-bd75-d357c8baf81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:52.421715 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae25d8-8cda-47f4-bd75-d357c8baf81f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:52.432116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1336/2680] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:52.436112 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b7e75-9517-4f17-94c1-6f839de6e7b9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:52.447103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b7e75-9517-4f17-94c1-6f839de6e7b9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:52.452466 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e0587-9463-432b-90c0-5e35b161e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:52.453198 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0587-9463-432b-90c0-5e35b161e36a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:52.453548 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0587-9463-432b-90c0-5e35b161e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:52.453890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0587-9463-432b-90c0-5e35b161e36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:52.454708 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e0587-9463-432b-90c0-5e35b161e36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:52.456506 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e0587-9463-432b-90c0-5e35b161e36a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:52.467487 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1345/2681] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:52.471325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae25d8-8cda-47f4-bd75-d357c8baf81f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:52.481828 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae25d8-8cda-47f4-bd75-d357c8baf81f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:52.488255 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756802f-acf3-423e-95e3-dddfb99299c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:52.490048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756802f-acf3-423e-95e3-dddfb99299c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:52.490695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756802f-acf3-423e-95e3-dddfb99299c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:52.491257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756802f-acf3-423e-95e3-dddfb99299c8 admin admin] PATH_INFO: `/v3/projects/cf08d1a8e8dc4438b666de8074265a31/users/d1c53b9c9dbf4be78788d118299c5ac9/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:52.513049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756802f-acf3-423e-95e3-dddfb99299c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf08d1a8e8dc4438b666de8074265a31, user_id=d1c53b9c9dbf4be78788d118299c5ac9, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:52.516280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756802f-acf3-423e-95e3-dddfb99299c8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:52.604995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1337/2682] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:52 2022] PUT /identity/v3/projects/cf08d1a8e8dc4438b666de8074265a31/users/d1c53b9c9dbf4be78788d118299c5ac9/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:47:52.616324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1ba9-497b-4480-9f76-e0a7585b6369 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:52.616684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1ba9-497b-4480-9f76-e0a7585b6369 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:52.617562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1ba9-497b-4480-9f76-e0a7585b6369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:52.644593 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-463e1ba9-497b-4480-9f76-e0a7585b6369 None None] MFA Rules not processed for user `d1c53b9c9dbf4be78788d118299c5ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:52.645811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-463e1ba9-497b-4480-9f76-e0a7585b6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:52.697216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:52.715018 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1346/2683] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:52.719651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756802f-acf3-423e-95e3-dddfb99299c8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:52.739878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:52.794680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756802f-acf3-423e-95e3-dddfb99299c8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:52.799523 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a878a28-1f4d-4994-b760-89599a40dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:52.800225 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a878a28-1f4d-4994-b760-89599a40dc58 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:52.800564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a878a28-1f4d-4994-b760-89599a40dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:52.800772 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a878a28-1f4d-4994-b760-89599a40dc58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:52.801466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a878a28-1f4d-4994-b760-89599a40dc58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:52.803340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a878a28-1f4d-4994-b760-89599a40dc58 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:52.883150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1338/2684] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:52 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:52.885097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e1ba9-497b-4480-9f76-e0a7585b6369 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:52.896134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e1ba9-497b-4480-9f76-e0a7585b6369 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:52.952279 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c04ba0-d745-4380-974c-129dff3ac455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:52.952975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04ba0-d745-4380-974c-129dff3ac455 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:52.953566 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04ba0-d745-4380-974c-129dff3ac455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:52.953995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04ba0-d745-4380-974c-129dff3ac455 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:52.955123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c04ba0-d745-4380-974c-129dff3ac455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:52.957080 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c04ba0-d745-4380-974c-129dff3ac455 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.114577 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1347/2685] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:52 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:53.119065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a878a28-1f4d-4994-b760-89599a40dc58 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.129637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a878a28-1f4d-4994-b760-89599a40dc58 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.134365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed285d4d-c4ef-40d7-9a39-fc881ab02211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.135078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285d4d-c4ef-40d7-9a39-fc881ab02211 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.135355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285d4d-c4ef-40d7-9a39-fc881ab02211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.135630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285d4d-c4ef-40d7-9a39-fc881ab02211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.137011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed285d4d-c4ef-40d7-9a39-fc881ab02211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.138682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed285d4d-c4ef-40d7-9a39-fc881ab02211 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.153932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1339/2686] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:53.155228 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c04ba0-d745-4380-974c-129dff3ac455 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.166092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c04ba0-d745-4380-974c-129dff3ac455 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.171324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1948-bd6d-4146-9b35-d448f85174bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.172327 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1948-bd6d-4146-9b35-d448f85174bb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.172611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1948-bd6d-4146-9b35-d448f85174bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.172877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1948-bd6d-4146-9b35-d448f85174bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.173718 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b1948-bd6d-4146-9b35-d448f85174bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.175386 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b1948-bd6d-4146-9b35-d448f85174bb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.188176 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1348/2687] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:53.192325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed285d4d-c4ef-40d7-9a39-fc881ab02211 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.202618 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed285d4d-c4ef-40d7-9a39-fc881ab02211 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.208917 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58b3eb-222e-40c5-871b-fdba071156d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.209919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58b3eb-222e-40c5-871b-fdba071156d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.210274 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58b3eb-222e-40c5-871b-fdba071156d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.211234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58b3eb-222e-40c5-871b-fdba071156d3 admin admin] PATH_INFO: `/v3/projects/675eb38e92a94f149334c15379d26589/users/66ff585052e54132b0d717b2ea3f16f3/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.228368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58b3eb-222e-40c5-871b-fdba071156d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675eb38e92a94f149334c15379d26589, user_id=66ff585052e54132b0d717b2ea3f16f3, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.231458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58b3eb-222e-40c5-871b-fdba071156d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.280219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1340/2688] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:53 2022] PUT /identity/v3/projects/675eb38e92a94f149334c15379d26589/users/66ff585052e54132b0d717b2ea3f16f3/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:53.291131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226e83-6895-4a42-a9fe-9ae01c7b1817 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.291424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226e83-6895-4a42-a9fe-9ae01c7b1817 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.291706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226e83-6895-4a42-a9fe-9ae01c7b1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.321247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1b226e83-6895-4a42-a9fe-9ae01c7b1817 None None] MFA Rules not processed for user `66ff585052e54132b0d717b2ea3f16f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:53.321943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1b226e83-6895-4a42-a9fe-9ae01c7b1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:53.401624 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1349/2689] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:47:53.403355 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58b3eb-222e-40c5-871b-fdba071156d3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.477680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58b3eb-222e-40c5-871b-fdba071156d3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.482667 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784098-ce93-49eb-a2f6-d64756ffa2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.483390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784098-ce93-49eb-a2f6-d64756ffa2ff admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.483668 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784098-ce93-49eb-a2f6-d64756ffa2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.483995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784098-ce93-49eb-a2f6-d64756ffa2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.484680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20784098-ce93-49eb-a2f6-d64756ffa2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.486553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20784098-ce93-49eb-a2f6-d64756ffa2ff admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.560919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1341/2690] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:47:53 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:53.564622 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b226e83-6895-4a42-a9fe-9ae01c7b1817 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.576210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b226e83-6895-4a42-a9fe-9ae01c7b1817 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.634297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f97d70-5983-4920-b93b-33548439326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.634974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97d70-5983-4920-b93b-33548439326f admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.635262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97d70-5983-4920-b93b-33548439326f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.635544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97d70-5983-4920-b93b-33548439326f admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.636278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f97d70-5983-4920-b93b-33548439326f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.638218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f97d70-5983-4920-b93b-33548439326f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.645207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:53.707786 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1350/2691] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:47:53 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:47:53.712430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784098-ce93-49eb-a2f6-d64756ffa2ff admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.722855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784098-ce93-49eb-a2f6-d64756ffa2ff admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.727473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3a48-ad2c-46da-963d-541298b2cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.728161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3a48-ad2c-46da-963d-541298b2cf35 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.728447 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3a48-ad2c-46da-963d-541298b2cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.728753 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3a48-ad2c-46da-963d-541298b2cf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.734127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d3a48-ad2c-46da-963d-541298b2cf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.734127 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d3a48-ad2c-46da-963d-541298b2cf35 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.742728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1342/2692] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:47:53.746799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f97d70-5983-4920-b93b-33548439326f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.757423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f97d70-5983-4920-b93b-33548439326f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.762742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc920e8-24b2-4758-bf0c-6b8db66df255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.763671 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc920e8-24b2-4758-bf0c-6b8db66df255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.764360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc920e8-24b2-4758-bf0c-6b8db66df255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.764990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc920e8-24b2-4758-bf0c-6b8db66df255 admin admin] PATH_INFO: `/v3/projects/2e950601862542f5b97d558d8cee0ec9/users/db2cef702e024d08a8f67e83e629c176/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.780874 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc920e8-24b2-4758-bf0c-6b8db66df255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e950601862542f5b97d558d8cee0ec9, user_id=db2cef702e024d08a8f67e83e629c176, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.783510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc920e8-24b2-4758-bf0c-6b8db66df255 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.822666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1351/2693] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:53 2022] PUT /identity/v3/projects/2e950601862542f5b97d558d8cee0ec9/users/db2cef702e024d08a8f67e83e629c176/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:47:53.826956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3a48-ad2c-46da-963d-541298b2cf35 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.838846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3a48-ad2c-46da-963d-541298b2cf35 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.871706 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:47:53.900243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0062f2-ff99-4e61-98cb-829bdc859289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.900865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0062f2-ff99-4e61-98cb-829bdc859289 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.901269 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0062f2-ff99-4e61-98cb-829bdc859289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.901559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0062f2-ff99-4e61-98cb-829bdc859289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.902287 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0062f2-ff99-4e61-98cb-829bdc859289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.903936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0062f2-ff99-4e61-98cb-829bdc859289 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.914332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1343/2694] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:47:53.918309 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc920e8-24b2-4758-bf0c-6b8db66df255 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:53.928928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc920e8-24b2-4758-bf0c-6b8db66df255 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:53.934808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:53.935663 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.935971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.936253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] PATH_INFO: `/v3/projects/2e950601862542f5b97d558d8cee0ec9/users/db2cef702e024d08a8f67e83e629c176/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.938385 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e950601862542f5b97d558d8cee0ec9, user_id=db2cef702e024d08a8f67e83e629c176, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:53.941206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:53.953705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1352/2695] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:47:53 2022] PUT /identity/v3/projects/2e950601862542f5b97d558d8cee0ec9/users/db2cef702e024d08a8f67e83e629c176/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:47:53.964826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444200b6-97c9-4452-910d-82ae1a966c6e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:53.965125 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444200b6-97c9-4452-910d-82ae1a966c6e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:53.965406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444200b6-97c9-4452-910d-82ae1a966c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:53.991587 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-444200b6-97c9-4452-910d-82ae1a966c6e None None] MFA Rules not processed for user `db2cef702e024d08a8f67e83e629c176`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:47:53.993316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-444200b6-97c9-4452-910d-82ae1a966c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:54.065464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1344/2696] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:47:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:47:54.077106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:54.078877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:47:54.136029 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20b6bc-2138-42aa-ad41-afc2f5e8c7db admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:54.139853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ce6c4-0899-495e-bf17-081fcda8b6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:54.140813 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ce6c4-0899-495e-bf17-081fcda8b6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:54.141214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ce6c4-0899-495e-bf17-081fcda8b6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:54.141494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ce6c4-0899-495e-bf17-081fcda8b6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:54.199555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ce6c4-0899-495e-bf17-081fcda8b6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:54.201050 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ce6c4-0899-495e-bf17-081fcda8b6c5 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:54.212278 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1353/2697] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:47:56.072024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444200b6-97c9-4452-910d-82ae1a966c6e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:56.081775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444200b6-97c9-4452-910d-82ae1a966c6e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:56.085390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49801f42-7644-4284-9aa4-ebba2f561718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:56.086067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49801f42-7644-4284-9aa4-ebba2f561718 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:56.086374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49801f42-7644-4284-9aa4-ebba2f561718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:56.086654 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49801f42-7644-4284-9aa4-ebba2f561718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:56.145177 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49801f42-7644-4284-9aa4-ebba2f561718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:56.146655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49801f42-7644-4284-9aa4-ebba2f561718 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:56.156713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1345/2698] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:47:57.461748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ce6c4-0899-495e-bf17-081fcda8b6c5 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:47:57.470270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ce6c4-0899-495e-bf17-081fcda8b6c5 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:47:57.473856 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e4bce-2bd5-4565-aefd-308a80b98ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:47:57.474772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4bce-2bd5-4565-aefd-308a80b98ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:47:57.474772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4bce-2bd5-4565-aefd-308a80b98ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:47:57.475037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4bce-2bd5-4565-aefd-308a80b98ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:47:57.484793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e4bce-2bd5-4565-aefd-308a80b98ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:47:57.486464 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e4bce-2bd5-4565-aefd-308a80b98ba0 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:47:57.497265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1354/2699] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:47:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:01.924129 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49801f42-7644-4284-9aa4-ebba2f561718 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:01.991330 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:02.006645 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49801f42-7644-4284-9aa4-ebba2f561718 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:02.011449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:02.012459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:02.017655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:02.017655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] PATH_INFO: `/v3/users/d1c53b9c9dbf4be78788d118299c5ac9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:02.017655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c53b9c9dbf4be78788d118299c5ac9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:02.017655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:02.171449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c53b9c9dbf4be78788d118299c5ac9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:02.228150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c53b9c9dbf4be78788d118299c5ac9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:02.240594 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c53b9c9dbf4be78788d118299c5ac9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:02.241253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c53b9c9dbf4be78788d118299c5ac9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:02.248765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c53b9c9dbf4be78788d118299c5ac9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:02.254904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1346/2700] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:48:01 2022] DELETE /identity/v3/users/d1c53b9c9dbf4be78788d118299c5ac9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:02.259238 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1eed-ed3d-4604-8d24-fcdc9152f663 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:02.259834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1eed-ed3d-4604-8d24-fcdc9152f663 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:02.260242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d1eed-ed3d-4604-8d24-fcdc9152f663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:02.279368 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ab4d1eed-ed3d-4604-8d24-fcdc9152f663 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:02.280877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab4d1eed-ed3d-4604-8d24-fcdc9152f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:02.342379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:02.358429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1355/2701] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:02.368620 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:02.370283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:02.433816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1deeb3-bbe8-4e3a-976b-8857a74f8a88 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:02.437470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578ed55-bfd7-44e9-90e0-9b4fd9a575b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:02.438112 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ed55-bfd7-44e9-90e0-9b4fd9a575b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:02.438396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ed55-bfd7-44e9-90e0-9b4fd9a575b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:02.438674 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ed55-bfd7-44e9-90e0-9b4fd9a575b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:02.447663 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578ed55-bfd7-44e9-90e0-9b4fd9a575b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:02.449280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578ed55-bfd7-44e9-90e0-9b4fd9a575b9 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:02.460530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1347/2702] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:02.938241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1eed-ed3d-4604-8d24-fcdc9152f663 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:02.938820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f209-f74f-412c-b455-91b2a5fb3a93 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:02.939262 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f209-f74f-412c-b455-91b2a5fb3a93 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:02.939413 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06f209-f74f-412c-b455-91b2a5fb3a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:02.940458 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab4d1eed-ed3d-4604-8d24-fcdc9152f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:02.953123 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d1eed-ed3d-4604-8d24-fcdc9152f663 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:02.957676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-db06f209-f74f-412c-b455-91b2a5fb3a93 None None] MFA Rules not processed for user `3e857898104242699e7590b527c2631f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:02.958640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:02.959038 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-db06f209-f74f-412c-b455-91b2a5fb3a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:02.959776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:02.960103 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:02.960914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] PATH_INFO: `/v3/projects/cf08d1a8e8dc4438b666de8074265a31` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:02.962723 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf08d1a8e8dc4438b666de8074265a31)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:02.973073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:03.023277 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1348/2703] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:03.065405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf08d1a8e8dc4438b666de8074265a31', 'request_id': 'req-ab49c88b-9347-4422-bd46-82b6e40401b6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.071113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf08d1a8e8dc4438b666de8074265a31', 'request_id': 'req-ab49c88b-9347-4422-bd46-82b6e40401b6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.077398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf08d1a8e8dc4438b666de8074265a31', 'request_id': 'req-ab49c88b-9347-4422-bd46-82b6e40401b6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.142232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] The token cache is being invalidate because project cf08d1a8e8dc4438b666de8074265a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:48:03.142525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.143152 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.144718 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1356/2704] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:48:02 2022] DELETE /identity/v3/projects/cf08d1a8e8dc4438b666de8074265a31 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:03.148653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06f209-f74f-412c-b455-91b2a5fb3a93 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:03.159960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06f209-f74f-412c-b455-91b2a5fb3a93 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:03.182217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:03.222474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:03.223374 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:03.223763 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:03.224071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] PATH_INFO: `/v3/users/66ff585052e54132b0d717b2ea3f16f3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:03.225354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ff585052e54132b0d717b2ea3f16f3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:03.228348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:03.384077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ff585052e54132b0d717b2ea3f16f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.432985 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ff585052e54132b0d717b2ea3f16f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.451206 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ff585052e54132b0d717b2ea3f16f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.452191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ff585052e54132b0d717b2ea3f16f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.460956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ff585052e54132b0d717b2ea3f16f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:03.467679 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1349/2705] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:48:03 2022] DELETE /identity/v3/users/66ff585052e54132b0d717b2ea3f16f3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:03.920754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:03.922233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:03.936791 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c88b-9347-4422-bd46-82b6e40401b6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:03.998169 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:04.000766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:04.001054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:04.001348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] PATH_INFO: `/v3/projects/675eb38e92a94f149334c15379d26589` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:04.004636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675eb38e92a94f149334c15379d26589)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:04.004636 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:04.193718 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675eb38e92a94f149334c15379d26589', 'request_id': 'req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.204560 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675eb38e92a94f149334c15379d26589', 'request_id': 'req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.211412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675eb38e92a94f149334c15379d26589', 'request_id': 'req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.295836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] The token cache is being invalidate because project 675eb38e92a94f149334c15379d26589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:48:04.296136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.296755 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.298376 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1357/2706] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:48:03 2022] DELETE /identity/v3/projects/675eb38e92a94f149334c15379d26589 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:04.302868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:04.304550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:04.319372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006ca1-6c00-4c03-9f03-ef7125e846fe admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:04.378504 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:04.379373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:04.379651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:04.379937 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] PATH_INFO: `/v3/users/db2cef702e024d08a8f67e83e629c176` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:04.381111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db2cef702e024d08a8f67e83e629c176)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:04.383001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:04.568743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:04.574964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db2cef702e024d08a8f67e83e629c176'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.668518 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db2cef702e024d08a8f67e83e629c176'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.682364 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db2cef702e024d08a8f67e83e629c176'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.683058 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db2cef702e024d08a8f67e83e629c176'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.689873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-254836ec-263f-44f8-a47e-76174b61aea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db2cef702e024d08a8f67e83e629c176'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:04.695635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1350/2707] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:48:04 2022] DELETE /identity/v3/users/db2cef702e024d08a8f67e83e629c176 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:05.132314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:05.134014 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:05.152805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a71930-b7a8-4e6e-82c6-efff8b3d3d34 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:05.156861 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:05.210359 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:05.211225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:05.211508 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:05.211788 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] PATH_INFO: `/v3/projects/2e950601862542f5b97d558d8cee0ec9` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:05.213035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e950601862542f5b97d558d8cee0ec9)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:05.214940 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:05.348588 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e950601862542f5b97d558d8cee0ec9', 'request_id': 'req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:05.354684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e950601862542f5b97d558d8cee0ec9', 'request_id': 'req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:05.362191 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e950601862542f5b97d558d8cee0ec9', 'request_id': 'req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:05.456193 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] The token cache is being invalidate because project 2e950601862542f5b97d558d8cee0ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:48:05.456413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:05.456988 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-622a174d-0a03-451a-b8db-a8f4e9ef0bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:05.458716 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1358/2708] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:48:05 2022] DELETE /identity/v3/projects/2e950601862542f5b97d558d8cee0ec9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:05.464294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963266a4-6a05-4e00-a35b-76def795da0c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:05.464751 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963266a4-6a05-4e00-a35b-76def795da0c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:05.464846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963266a4-6a05-4e00-a35b-76def795da0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:05.482531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-963266a4-6a05-4e00-a35b-76def795da0c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:05.483721 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-963266a4-6a05-4e00-a35b-76def795da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:05.544919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1351/2709] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:05.552666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c016-bf03-40fb-b909-3ef2f2a7a1bf None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:05.552953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c016-bf03-40fb-b909-3ef2f2a7a1bf None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:05.553230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c016-bf03-40fb-b909-3ef2f2a7a1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:05.571031 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-97e5c016-bf03-40fb-b909-3ef2f2a7a1bf None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:05.572284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-97e5c016-bf03-40fb-b909-3ef2f2a7a1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:05.580154 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1359/2710] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:48:05.584723 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963266a4-6a05-4e00-a35b-76def795da0c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:05.595986 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963266a4-6a05-4e00-a35b-76def795da0c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:05.600622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:05.601278 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:05.601561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:05.601835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:05.602560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:48:05.603501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:05.605162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:05.616736 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1352/2711] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:48:05.621098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5c016-bf03-40fb-b909-3ef2f2a7a1bf None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:05.630966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5c016-bf03-40fb-b909-3ef2f2a7a1bf None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:05.635742 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e4d96-269c-43a9-b812-bdfa44f06100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:05.636416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4d96-269c-43a9-b812-bdfa44f06100 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:05.636702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4d96-269c-43a9-b812-bdfa44f06100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:05.636976 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4d96-269c-43a9-b812-bdfa44f06100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:05.637752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4d96-269c-43a9-b812-bdfa44f06100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:05.640110 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4d96-269c-43a9-b812-bdfa44f06100 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:05.823898 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1360/2712] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:48:05 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:48:05.828056 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:05.837785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc1b6-0907-4613-b6ac-90c90eae7a32 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:05.897979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8eef-6c38-48a9-b1bf-e7f7789ba377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:05.898655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8eef-6c38-48a9-b1bf-e7f7789ba377 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:05.898935 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8eef-6c38-48a9-b1bf-e7f7789ba377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:05.899213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8eef-6c38-48a9-b1bf-e7f7789ba377 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:05.899975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8eef-6c38-48a9-b1bf-e7f7789ba377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:05.901879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8eef-6c38-48a9-b1bf-e7f7789ba377 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:05.988072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1353/2713] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:48:05 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:48:06.000350 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e4d96-269c-43a9-b812-bdfa44f06100 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:06.018402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e4d96-269c-43a9-b812-bdfa44f06100 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:06.023734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7556c-118c-4aab-ac5a-e514ef44b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:06.024325 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7556c-118c-4aab-ac5a-e514ef44b0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:06.024612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7556c-118c-4aab-ac5a-e514ef44b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:06.024892 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7556c-118c-4aab-ac5a-e514ef44b0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:06.025673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7556c-118c-4aab-ac5a-e514ef44b0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:06.027580 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7556c-118c-4aab-ac5a-e514ef44b0b6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:06.040789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1361/2714] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:48:06.044585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8eef-6c38-48a9-b1bf-e7f7789ba377 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:06.057796 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8eef-6c38-48a9-b1bf-e7f7789ba377 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:06.067709 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56209586-d6b7-42d9-8b09-4b3be9c4355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:06.068538 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56209586-d6b7-42d9-8b09-4b3be9c4355c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:06.068941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56209586-d6b7-42d9-8b09-4b3be9c4355c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:06.069340 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56209586-d6b7-42d9-8b09-4b3be9c4355c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:06.070366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56209586-d6b7-42d9-8b09-4b3be9c4355c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:06.072294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56209586-d6b7-42d9-8b09-4b3be9c4355c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:06.084009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1354/2715] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:48:06.087844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7556c-118c-4aab-ac5a-e514ef44b0b6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:06.098586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7556c-118c-4aab-ac5a-e514ef44b0b6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:06.104919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:06.105992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:06.106317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:06.107226 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] PATH_INFO: `/v3/projects/55879f0185264c2fa9f53d9701589e1b/users/7d0c3866fd9747d6b1f551458258eedc/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:06.125234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55879f0185264c2fa9f53d9701589e1b, user_id=7d0c3866fd9747d6b1f551458258eedc, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:06.127980 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:06.251618 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1362/2716] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:48:06 2022] PUT /identity/v3/projects/55879f0185264c2fa9f53d9701589e1b/users/7d0c3866fd9747d6b1f551458258eedc/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:06.263193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d8fbd-a54a-4ce7-bbe2-59ad35d2d8cd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:06.263193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d8fbd-a54a-4ce7-bbe2-59ad35d2d8cd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:06.263193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d8fbd-a54a-4ce7-bbe2-59ad35d2d8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:06.296999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dd7d8fbd-a54a-4ce7-bbe2-59ad35d2d8cd None None] MFA Rules not processed for user `7d0c3866fd9747d6b1f551458258eedc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:06.298210 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd7d8fbd-a54a-4ce7-bbe2-59ad35d2d8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:06.311294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:06.371185 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1355/2717] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:06.384631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:06.386405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:06.422670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:06.447547 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701508ee-636f-4bb1-aee7-c6caeac501e2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:06.451675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f1c0b-edeb-4f62-b920-f7e9b4873fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:06.452372 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f1c0b-edeb-4f62-b920-f7e9b4873fcc service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:06.452656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f1c0b-edeb-4f62-b920-f7e9b4873fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:06.452933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f1c0b-edeb-4f62-b920-f7e9b4873fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:06.462785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f1c0b-edeb-4f62-b920-f7e9b4873fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:06.464453 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f1c0b-edeb-4f62-b920-f7e9b4873fcc service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:06.473726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1363/2718] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:09.487876 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d8fbd-a54a-4ce7-bbe2-59ad35d2d8cd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:09.551006 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d8fbd-a54a-4ce7-bbe2-59ad35d2d8cd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:09.555420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:09.556827 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:09.557106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:09.557373 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] PATH_INFO: `/v3/users/7d0c3866fd9747d6b1f551458258eedc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:09.558542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0c3866fd9747d6b1f551458258eedc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:09.560476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:09.715297 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0c3866fd9747d6b1f551458258eedc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:09.776201 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0c3866fd9747d6b1f551458258eedc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:09.788786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0c3866fd9747d6b1f551458258eedc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:09.789435 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0c3866fd9747d6b1f551458258eedc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:09.796790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0c3866fd9747d6b1f551458258eedc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:09.802696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1356/2719] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:48:09 2022] DELETE /identity/v3/users/7d0c3866fd9747d6b1f551458258eedc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:09.807998 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1cb03-bfa5-4561-812e-f001d53f35a7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:09.808501 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1cb03-bfa5-4561-812e-f001d53f35a7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:09.808601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1cb03-bfa5-4561-812e-f001d53f35a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:09.826502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3ee1cb03-bfa5-4561-812e-f001d53f35a7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:09.827703 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ee1cb03-bfa5-4561-812e-f001d53f35a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:09.888752 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1364/2720] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:09.898460 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:09.899874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:09.936789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:09.957879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f284b7-e2c3-407a-a8c4-f800ad9f88e2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:09.961527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd846a74-2dd8-4494-8526-27ad74bcd3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:09.962168 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846a74-2dd8-4494-8526-27ad74bcd3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:09.962546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846a74-2dd8-4494-8526-27ad74bcd3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:09.962831 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd846a74-2dd8-4494-8526-27ad74bcd3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:09.973701 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd846a74-2dd8-4494-8526-27ad74bcd3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:09.975212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd846a74-2dd8-4494-8526-27ad74bcd3f9 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:09.985958 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1357/2721] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:10.377467 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1cb03-bfa5-4561-812e-f001d53f35a7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:10.379012 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3ee1cb03-bfa5-4561-812e-f001d53f35a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:10.393430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1cb03-bfa5-4561-812e-f001d53f35a7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:10.398160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:10.399015 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:10.399290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:10.400216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] PATH_INFO: `/v3/projects/55879f0185264c2fa9f53d9701589e1b` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:10.401539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55879f0185264c2fa9f53d9701589e1b)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:10.403601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:10.484054 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55879f0185264c2fa9f53d9701589e1b', 'request_id': 'req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:10.490187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55879f0185264c2fa9f53d9701589e1b', 'request_id': 'req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:10.497002 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55879f0185264c2fa9f53d9701589e1b', 'request_id': 'req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:10.558271 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] The token cache is being invalidate because project 55879f0185264c2fa9f53d9701589e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:48:10.558611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:10.559146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-62e1fbe1-1eaf-4b75-a0f1-8b196df3df6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:48:10.560711 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1365/2722] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:48:10 2022] DELETE /identity/v3/projects/55879f0185264c2fa9f53d9701589e1b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:48:10.565599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451c4fe-0256-4047-8373-cfe10245d53b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:10.566071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451c4fe-0256-4047-8373-cfe10245d53b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:10.566188 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451c4fe-0256-4047-8373-cfe10245d53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:10.583703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3451c4fe-0256-4047-8373-cfe10245d53b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:10.584912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3451c4fe-0256-4047-8373-cfe10245d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:10.645283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1358/2723] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:10.655550 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909725ef-bc36-49e7-9930-3a8d20f7f0b9 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:10.655844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909725ef-bc36-49e7-9930-3a8d20f7f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:10.656157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909725ef-bc36-49e7-9930-3a8d20f7f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:10.674397 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-909725ef-bc36-49e7-9930-3a8d20f7f0b9 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:10.675714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-909725ef-bc36-49e7-9930-3a8d20f7f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:10.684335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1366/2724] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:10.688782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451c4fe-0256-4047-8373-cfe10245d53b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:10.699182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451c4fe-0256-4047-8373-cfe10245d53b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:10.703860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:10.704543 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:10.704854 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:10.705134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:10.705929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:48:10.706240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:10.707834 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:10.719988 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1359/2725] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:48:10.724130 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909725ef-bc36-49e7-9930-3a8d20f7f0b9 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:10.733499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909725ef-bc36-49e7-9930-3a8d20f7f0b9 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:10.738334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13262-f35c-45ef-958d-8473d68f1206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:10.739016 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13262-f35c-45ef-958d-8473d68f1206 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:10.739300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13262-f35c-45ef-958d-8473d68f1206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:10.739612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13262-f35c-45ef-958d-8473d68f1206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:10.740396 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e13262-f35c-45ef-958d-8473d68f1206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:10.742369 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e13262-f35c-45ef-958d-8473d68f1206 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:10.892646 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1367/2726] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:48:10 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:48:10.896843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:10.907873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d7c5-3f34-4ecc-bd68-92dc94acd8cf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:10.967492 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffbaf3-6f70-4af9-8095-3bdfa2d53c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:10.968195 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbaf3-6f70-4af9-8095-3bdfa2d53c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:10.968480 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbaf3-6f70-4af9-8095-3bdfa2d53c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:10.968755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbaf3-6f70-4af9-8095-3bdfa2d53c05 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:10.969450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffbaf3-6f70-4af9-8095-3bdfa2d53c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:10.971360 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffbaf3-6f70-4af9-8095-3bdfa2d53c05 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:11.067665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1360/2727] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:48:10 2022] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:48:11.071790 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13262-f35c-45ef-958d-8473d68f1206 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:11.082098 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13262-f35c-45ef-958d-8473d68f1206 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:11.086759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea42cb6-6f64-4309-a8cd-7ede3c25808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:11.088004 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42cb6-6f64-4309-a8cd-7ede3c25808e admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:11.088286 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42cb6-6f64-4309-a8cd-7ede3c25808e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:11.088644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea42cb6-6f64-4309-a8cd-7ede3c25808e admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:11.089365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea42cb6-6f64-4309-a8cd-7ede3c25808e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:11.090991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea42cb6-6f64-4309-a8cd-7ede3c25808e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:11.101823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1368/2728] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:48:11.107851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffbaf3-6f70-4af9-8095-3bdfa2d53c05 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:11.116664 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffbaf3-6f70-4af9-8095-3bdfa2d53c05 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:11.121215 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ca011-12d0-4f17-ab78-fd47afc86e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:11.121867 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca011-12d0-4f17-ab78-fd47afc86e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:11.122150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca011-12d0-4f17-ab78-fd47afc86e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:11.122425 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca011-12d0-4f17-ab78-fd47afc86e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:11.123147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ca011-12d0-4f17-ab78-fd47afc86e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:11.124763 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ca011-12d0-4f17-ab78-fd47afc86e87 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:11.137115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1361/2729] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:48:11.141365 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea42cb6-6f64-4309-a8cd-7ede3c25808e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:11.152319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea42cb6-6f64-4309-a8cd-7ede3c25808e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:11.161612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:11.164526 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:11.164917 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:11.165230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] PATH_INFO: `/v3/projects/96b092ee7c684eee99ba41f1996cc29c/users/1e9c50821f3a4eb79f860c5dddae2a65/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:11.180331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b092ee7c684eee99ba41f1996cc29c, user_id=1e9c50821f3a4eb79f860c5dddae2a65, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:11.183058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:11.186730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:11.255733 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1369/2730] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:48:11 2022] PUT /identity/v3/projects/96b092ee7c684eee99ba41f1996cc29c/users/1e9c50821f3a4eb79f860c5dddae2a65/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:48:11.267109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc9dc-d537-4e71-8edc-7b96fa87e5a0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:11.267396 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc9dc-d537-4e71-8edc-7b96fa87e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:11.267676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc9dc-d537-4e71-8edc-7b96fa87e5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:11.294044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-718dc9dc-d537-4e71-8edc-7b96fa87e5a0 None None] MFA Rules not processed for user `1e9c50821f3a4eb79f860c5dddae2a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:11.295239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-718dc9dc-d537-4e71-8edc-7b96fa87e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:11.325992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:11.360187 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1362/2731] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:11.373555 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:11.375330 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:11.432833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2c05-bee6-421d-838d-ec21d04ad3e6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:11.436490 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf397d-54c8-48e9-8851-54d39f6d27bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:11.437133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf397d-54c8-48e9-8851-54d39f6d27bd service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:11.437415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf397d-54c8-48e9-8851-54d39f6d27bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:11.437688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf397d-54c8-48e9-8851-54d39f6d27bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:11.445799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf397d-54c8-48e9-8851-54d39f6d27bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:11.447739 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf397d-54c8-48e9-8851-54d39f6d27bd service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:11.456422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1370/2732] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:21.392892 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=13 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:21.452378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=28 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:47.948939 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc9dc-d537-4e71-8edc-7b96fa87e5a0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:47.950324 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-718dc9dc-d537-4e71-8edc-7b96fa87e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:48.018565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc9dc-d537-4e71-8edc-7b96fa87e5a0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:48.023476 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:48.024140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:48.024418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:48.024691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:48.026458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:48.037403 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:48.038943 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:48.048953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1363/2733] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:58.044606 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=32 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:59.639850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ca316-b109-41a2-a742-be54bfb32a69 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:59.640375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ca316-b109-41a2-a742-be54bfb32a69 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:59.640488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ca316-b109-41a2-a742-be54bfb32a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:59.658262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-0a4ca316-b109-41a2-a742-be54bfb32a69 None None] MFA Rules not processed for user `513b7a90f9fe4d91aea642eae12b3753`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:59.659442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0a4ca316-b109-41a2-a742-be54bfb32a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:59.713658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1371/2734] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:48:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:49:00.993214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:01.053761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3cbf-9579-4b2d-ab81-e9ff8ee41caa service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:01.058276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:01.059136 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:01.059416 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:01.059691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] PATH_INFO: `/v3/users/1e9c50821f3a4eb79f860c5dddae2a65` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:01.060910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9c50821f3a4eb79f860c5dddae2a65)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:01.062888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:01.223401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9c50821f3a4eb79f860c5dddae2a65'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:01.306679 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9c50821f3a4eb79f860c5dddae2a65'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:01.319448 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9c50821f3a4eb79f860c5dddae2a65'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:01.320123 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9c50821f3a4eb79f860c5dddae2a65'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:01.326797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9c50821f3a4eb79f860c5dddae2a65'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:01.333637 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1364/2735] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:49:00 2022] DELETE /identity/v3/users/1e9c50821f3a4eb79f860c5dddae2a65 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:49:01.338030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56cbc4-c93d-4e14-b8b0-49c08d517b26 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:01.338517 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56cbc4-c93d-4e14-b8b0-49c08d517b26 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:01.338613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56cbc4-c93d-4e14-b8b0-49c08d517b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:01.355715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fe56cbc4-c93d-4e14-b8b0-49c08d517b26 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:49:01.356928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe56cbc4-c93d-4e14-b8b0-49c08d517b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:01.416656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1372/2736] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:49:01.426835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:01.428473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:01.494858 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09de812-467b-49f3-9dc4-30150772dcab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:01.498639 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9767a3-df7c-4578-bc4d-dec33a4d0eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:01.499335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9767a3-df7c-4578-bc4d-dec33a4d0eae service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:01.499707 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9767a3-df7c-4578-bc4d-dec33a4d0eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:01.500015 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9767a3-df7c-4578-bc4d-dec33a4d0eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:01.510599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9767a3-df7c-4578-bc4d-dec33a4d0eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:01.512080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9767a3-df7c-4578-bc4d-dec33a4d0eae service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:01.523570 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1365/2737] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:49:01.953851 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56cbc4-c93d-4e14-b8b0-49c08d517b26 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:01.955275 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe56cbc4-c93d-4e14-b8b0-49c08d517b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:01.966891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56cbc4-c93d-4e14-b8b0-49c08d517b26 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:01.972147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:01.972994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:01.973267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:01.973559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] PATH_INFO: `/v3/projects/96b092ee7c684eee99ba41f1996cc29c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:01.974757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b092ee7c684eee99ba41f1996cc29c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:01.976710 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:02.078283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b092ee7c684eee99ba41f1996cc29c', 'request_id': 'req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:02.083850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b092ee7c684eee99ba41f1996cc29c', 'request_id': 'req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:02.090612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b092ee7c684eee99ba41f1996cc29c', 'request_id': 'req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:02.195144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] The token cache is being invalidate because project 96b092ee7c684eee99ba41f1996cc29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:49:02.195552 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:02.196366 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-a64537f0-5f8e-48b9-a29d-1b4f2f9fe0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:02.198032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1373/2738] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:49:01 2022] DELETE /identity/v3/projects/96b092ee7c684eee99ba41f1996cc29c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:49:02.203069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74790b01-b89b-4b53-bb12-31e2cc493c4f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.203544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74790b01-b89b-4b53-bb12-31e2cc493c4f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.203853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74790b01-b89b-4b53-bb12-31e2cc493c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.223874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-74790b01-b89b-4b53-bb12-31e2cc493c4f None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:49:02.225376 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-74790b01-b89b-4b53-bb12-31e2cc493c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:02.245075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:02.306965 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1366/2739] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:49:02.316215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c27f82-4d7f-4742-95b4-3110f114c9fd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.316598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c27f82-4d7f-4742-95b4-3110f114c9fd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.316932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c27f82-4d7f-4742-95b4-3110f114c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.336662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-64c27f82-4d7f-4742-95b4-3110f114c9fd None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:49:02.337871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-64c27f82-4d7f-4742-95b4-3110f114c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:02.346478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1374/2740] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:49:02.350744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74790b01-b89b-4b53-bb12-31e2cc493c4f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:02.364577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74790b01-b89b-4b53-bb12-31e2cc493c4f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:02.370755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:02.371529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.371874 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.372243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.373091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:49:02.373461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:02.375245 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:02.392091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1367/2741] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:49:02.394539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c27f82-4d7f-4742-95b4-3110f114c9fd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:02.404439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c27f82-4d7f-4742-95b4-3110f114c9fd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:02.419348 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5458d-89c8-4bbb-a76f-cf2147d49811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:02.420046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5458d-89c8-4bbb-a76f-cf2147d49811 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.420331 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5458d-89c8-4bbb-a76f-cf2147d49811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.420610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5458d-89c8-4bbb-a76f-cf2147d49811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.421423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5458d-89c8-4bbb-a76f-cf2147d49811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:02.423314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5458d-89c8-4bbb-a76f-cf2147d49811 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:02.517028 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:02.523684 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1375/2742] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:49:02 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:49:02.527787 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:02.538659 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00fad7-6f0a-4271-bf2f-b350d5f095e0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:02.597524 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913e46b-bd15-4f35-8b98-31b5c6dcfd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:02.598130 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913e46b-bd15-4f35-8b98-31b5c6dcfd9a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.598564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913e46b-bd15-4f35-8b98-31b5c6dcfd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.598878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913e46b-bd15-4f35-8b98-31b5c6dcfd9a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.599586 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913e46b-bd15-4f35-8b98-31b5c6dcfd9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:02.601616 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913e46b-bd15-4f35-8b98-31b5c6dcfd9a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:02.653532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1368/2743] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:49:02 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:49:02.656399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5458d-89c8-4bbb-a76f-cf2147d49811 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:02.678715 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5458d-89c8-4bbb-a76f-cf2147d49811 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:02.689995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa131f-4a1c-4e7f-aff0-ea9e084c1e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:02.689995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa131f-4a1c-4e7f-aff0-ea9e084c1e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.689995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa131f-4a1c-4e7f-aff0-ea9e084c1e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.689995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa131f-4a1c-4e7f-aff0-ea9e084c1e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.696568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa131f-4a1c-4e7f-aff0-ea9e084c1e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:02.696568 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa131f-4a1c-4e7f-aff0-ea9e084c1e93 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:02.712100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1376/2744] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:49:02.712809 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913e46b-bd15-4f35-8b98-31b5c6dcfd9a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:02.724539 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913e46b-bd15-4f35-8b98-31b5c6dcfd9a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:02.736305 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710112b-67f5-481c-b0ed-2d045c81cca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:02.742630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710112b-67f5-481c-b0ed-2d045c81cca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.742630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710112b-67f5-481c-b0ed-2d045c81cca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.742630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710112b-67f5-481c-b0ed-2d045c81cca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.742630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710112b-67f5-481c-b0ed-2d045c81cca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:02.742630 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710112b-67f5-481c-b0ed-2d045c81cca7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:02.770342 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1369/2745] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:49:02.772886 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa131f-4a1c-4e7f-aff0-ea9e084c1e93 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:02.783256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa131f-4a1c-4e7f-aff0-ea9e084c1e93 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:02.790871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:02.790871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.790871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.790871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] PATH_INFO: `/v3/projects/58c2894d46f64538bdd0713cf45a4e11/users/d1a2d251dbb14994b31deee6fd13e725/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.813146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c2894d46f64538bdd0713cf45a4e11, user_id=d1a2d251dbb14994b31deee6fd13e725, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:02.824779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:02.908648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1377/2746] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:49:02 2022] PUT /identity/v3/projects/58c2894d46f64538bdd0713cf45a4e11/users/d1a2d251dbb14994b31deee6fd13e725/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:49:02.919235 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e022a-f15e-4af4-8d3e-43de7dbd99c9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:02.919526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e022a-f15e-4af4-8d3e-43de7dbd99c9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:02.919810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e022a-f15e-4af4-8d3e-43de7dbd99c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:02.957564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-880e022a-f15e-4af4-8d3e-43de7dbd99c9 None None] MFA Rules not processed for user `d1a2d251dbb14994b31deee6fd13e725`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:49:02.958800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-880e022a-f15e-4af4-8d3e-43de7dbd99c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:03.033300 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1370/2747] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:49:03.045333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:03.047088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:03.112367 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a36b95-2eb8-4191-b157-d241841abc3f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:03.116244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db2701-836f-47ec-bd42-17f392d27e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:03.116837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2701-836f-47ec-bd42-17f392d27e63 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:03.117122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2701-836f-47ec-bd42-17f392d27e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:03.117405 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db2701-836f-47ec-bd42-17f392d27e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:03.127751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db2701-836f-47ec-bd42-17f392d27e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:03.129424 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db2701-836f-47ec-bd42-17f392d27e63 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:03.139073 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1378/2748] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:49:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:49:03.168454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e022a-f15e-4af4-8d3e-43de7dbd99c9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:03.186599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:03.229915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e022a-f15e-4af4-8d3e-43de7dbd99c9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:03.235390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:03.236506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:03.236791 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:03.237071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] PATH_INFO: `/v3/users/d1a2d251dbb14994b31deee6fd13e725` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:03.238280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a2d251dbb14994b31deee6fd13e725)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:03.240272 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:03.406411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a2d251dbb14994b31deee6fd13e725'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:03.490007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a2d251dbb14994b31deee6fd13e725'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:03.502464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a2d251dbb14994b31deee6fd13e725'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:03.503091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a2d251dbb14994b31deee6fd13e725'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:03.510042 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a2d251dbb14994b31deee6fd13e725'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:03.515817 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1371/2749] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:49:03 2022] DELETE /identity/v3/users/d1a2d251dbb14994b31deee6fd13e725 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:49:03.520783 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57753ee8-c269-4594-85d8-97dddbee95da None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:03.521265 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57753ee8-c269-4594-85d8-97dddbee95da None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:03.521373 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57753ee8-c269-4594-85d8-97dddbee95da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:03.538400 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-57753ee8-c269-4594-85d8-97dddbee95da None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:49:03.539591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-57753ee8-c269-4594-85d8-97dddbee95da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:03.597122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1379/2750] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:49:03.606990 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:03.608516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:03.669241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876247c7-b115-4d26-9311-3dd179b5c452 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:03.673394 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca79b8-7b89-4156-b224-4b6670c1c3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:03.674036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca79b8-7b89-4156-b224-4b6670c1c3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:03.674319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca79b8-7b89-4156-b224-4b6670c1c3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:03.674598 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca79b8-7b89-4156-b224-4b6670c1c3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:03.683282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca79b8-7b89-4156-b224-4b6670c1c3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:03.684794 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca79b8-7b89-4156-b224-4b6670c1c3c5 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:03.694161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1372/2751] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:49:04.080811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57753ee8-c269-4594-85d8-97dddbee95da None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:04.082281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-57753ee8-c269-4594-85d8-97dddbee95da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:04.095435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57753ee8-c269-4594-85d8-97dddbee95da None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:04.100210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:04.101063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:04.101344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:04.101619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] PATH_INFO: `/v3/projects/58c2894d46f64538bdd0713cf45a4e11` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:04.102824 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c2894d46f64538bdd0713cf45a4e11)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:04.108637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:04.186211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c2894d46f64538bdd0713cf45a4e11', 'request_id': 'req-9874acf8-f509-49aa-874f-24e063f1f78c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:04.192374 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c2894d46f64538bdd0713cf45a4e11', 'request_id': 'req-9874acf8-f509-49aa-874f-24e063f1f78c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:04.198626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c2894d46f64538bdd0713cf45a4e11', 'request_id': 'req-9874acf8-f509-49aa-874f-24e063f1f78c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:04.200289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:04.242704 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] The token cache is being invalidate because project 58c2894d46f64538bdd0713cf45a4e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:49:04.243019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:04.243637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:04.245262 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1380/2752] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:49:04 2022] DELETE /identity/v3/projects/58c2894d46f64538bdd0713cf45a4e11 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:49:13.689954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:14.283871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:20.410880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13f79-9204-4eb7-913c-8b9bb0093a38 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:20.411366 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13f79-9204-4eb7-913c-8b9bb0093a38 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:20.411491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13f79-9204-4eb7-913c-8b9bb0093a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:20.428386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1eb13f79-9204-4eb7-913c-8b9bb0093a38 None None] MFA Rules not processed for user `3e857898104242699e7590b527c2631f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:49:20.430774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1eb13f79-9204-4eb7-913c-8b9bb0093a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:20.482711 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1373/2753] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:49:30.476250 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:06.328954 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:50:06.330398 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:50:06.395297 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874acf8-f509-49aa-874f-24e063f1f78c admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:50:06.399807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:50:06.400685 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:50:06.400964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:50:06.401236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] PATH_INFO: `/v3/users/513b7a90f9fe4d91aea642eae12b3753` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:50:06.402395 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513b7a90f9fe4d91aea642eae12b3753)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:50:06.404352 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:50:06.547596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513b7a90f9fe4d91aea642eae12b3753'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:06.554799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513b7a90f9fe4d91aea642eae12b3753'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:06.597549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513b7a90f9fe4d91aea642eae12b3753'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:06.598170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513b7a90f9fe4d91aea642eae12b3753'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:06.609906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513b7a90f9fe4d91aea642eae12b3753'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:06.616415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1381/2754] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:50:06 2022] DELETE /identity/v3/users/513b7a90f9fe4d91aea642eae12b3753 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:50:06.833473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13f79-9204-4eb7-913c-8b9bb0093a38 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:50:06.845918 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13f79-9204-4eb7-913c-8b9bb0093a38 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:50:06.903536 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:50:06.904431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:50:06.904731 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:50:06.905117 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] PATH_INFO: `/v3/projects/c0de2588b13e487a91aaf1ad7ea7bd6f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:50:06.906296 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0de2588b13e487a91aaf1ad7ea7bd6f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:50:06.908211 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:50:07.032505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'request_id': 'req-a6eb41fd-607e-483c-8905-f263a9b74a89'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:07.038689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'request_id': 'req-a6eb41fd-607e-483c-8905-f263a9b74a89'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:07.044847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0de2588b13e487a91aaf1ad7ea7bd6f', 'request_id': 'req-a6eb41fd-607e-483c-8905-f263a9b74a89'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:07.116808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] The token cache is being invalidate because project c0de2588b13e487a91aaf1ad7ea7bd6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:50:07.117028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:07.117682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:50:07.119224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1374/2755] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:50:06 2022] DELETE /identity/v3/projects/c0de2588b13e487a91aaf1ad7ea7bd6f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:50:16.612266 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:17.113611 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:21.279635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:50:21.281094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:50:21.337603 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729e056-e57d-4f75-858e-48116d587ee2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:50:21.384497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070579b-d4be-4f78-841a-295f04da6a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:50:21.385652 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070579b-d4be-4f78-841a-295f04da6a7a service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:50:21.385933 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070579b-d4be-4f78-841a-295f04da6a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:50:21.386204 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070579b-d4be-4f78-841a-295f04da6a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:50:21.388003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1070579b-d4be-4f78-841a-295f04da6a7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:50:21.456585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070579b-d4be-4f78-841a-295f04da6a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:50:21.458017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070579b-d4be-4f78-841a-295f04da6a7a service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:50:21.468792 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1382/2756] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:50:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:50:29.562512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:50:29.564019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:50:29.576793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb41fd-607e-483c-8905-f263a9b74a89 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:50:29.580399 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:50:29.581043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:50:29.581327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:50:29.581696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:50:29.583542 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:50:29.597011 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:50:29.598505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:50:29.609790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1375/2757] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:50:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:50:31.464072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=74 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:39.604779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:40.250784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24785a-6975-42d2-b1c6-882040e4ae9e None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:50:40.251289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24785a-6975-42d2-b1c6-882040e4ae9e None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:50:40.251402 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24785a-6975-42d2-b1c6-882040e4ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:50:40.269274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-ab24785a-6975-42d2-b1c6-882040e4ae9e None None] MFA Rules not processed for user `3e857898104242699e7590b527c2631f`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:50:40.270478 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-ab24785a-6975-42d2-b1c6-882040e4ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:50:40.324605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1383/2758] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:50:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:50:43.786362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:50:43.787777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:50:43.845455 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e359d5a-664c-47dc-8f5f-98c9e891fe33 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:50:43.852302 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:50:43.853092 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:50:43.853222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:50:43.853501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:50:43.855976 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:50:43.865758 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:50:43.867119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:50:43.875091 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1376/2759] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:50:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:50:50.317793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=25 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:53.871449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=26 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:47.906573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24785a-6975-42d2-b1c6-882040e4ae9e None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:47.916075 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24785a-6975-42d2-b1c6-882040e4ae9e None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:47.920307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:47.920939 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:47.921218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:47.921492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:47.923250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:47.934056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:47.935471 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:47.944512 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1384/2760] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:51:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:51:50.660307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:50.669240 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc8e0b-e2ef-42f1-8a53-a43a07b5a4a9 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:50.672789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:50.673411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:50.673689 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:50.673962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:50.675697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:50.737412 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:50.738895 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:50.748401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1377/2761] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:51:54.124095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:54.125562 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:54.139384 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae249f-6b2a-4b83-b0fc-cadc6525f577 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:54.144125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:54.144979 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:54.145257 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:54.145648 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] PATH_INFO: `/v3/users/3e857898104242699e7590b527c2631f` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:54.146818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e857898104242699e7590b527c2631f)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:54.148762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:54.346362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e857898104242699e7590b527c2631f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.353135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e857898104242699e7590b527c2631f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.407799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e857898104242699e7590b527c2631f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.408448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e857898104242699e7590b527c2631f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.421251 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-540d2473-0397-4b61-870a-fa70e665bb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e857898104242699e7590b527c2631f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.427295 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1385/2762] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:51:54 2022] DELETE /identity/v3/users/3e857898104242699e7590b527c2631f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:51:54.672877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:54.684062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3963a-692c-47d1-a46f-186f9e614ad8 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:54.742345 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:54.743203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:54.743482 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:54.743755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] PATH_INFO: `/v3/projects/c73dcc78ab7c47abbb0dceebb5e212f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:54.744957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73dcc78ab7c47abbb0dceebb5e212f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:54.746838 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:54.864142 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'request_id': 'req-413c2851-983b-4d9d-af07-98ce9a0e6626'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.869402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'request_id': 'req-413c2851-983b-4d9d-af07-98ce9a0e6626'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.875332 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73dcc78ab7c47abbb0dceebb5e212f2', 'request_id': 'req-413c2851-983b-4d9d-af07-98ce9a0e6626'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.937859 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] The token cache is being invalidate because project c73dcc78ab7c47abbb0dceebb5e212f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:51:54.938078 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.938696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-413c2851-983b-4d9d-af07-98ce9a0e6626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:54.940299 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1378/2763] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:51:54 2022] DELETE /identity/v3/projects/c73dcc78ab7c47abbb0dceebb5e212f2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:51:54.945333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17542-5378-4cc8-bdb3-856652feac88 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:54.945559 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17542-5378-4cc8-bdb3-856652feac88 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:54.945837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd17542-5378-4cc8-bdb3-856652feac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:54.963492 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-4cd17542-5378-4cc8-bdb3-856652feac88 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:51:54.964754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-4cd17542-5378-4cc8-bdb3-856652feac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:55.021273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1386/2764] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:51:55.029005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985b2bf-6023-4cfb-bb1f-16e7706ef413 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.029295 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985b2bf-6023-4cfb-bb1f-16e7706ef413 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.030165 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985b2bf-6023-4cfb-bb1f-16e7706ef413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.048093 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a985b2bf-6023-4cfb-bb1f-16e7706ef413 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:51:55.049280 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a985b2bf-6023-4cfb-bb1f-16e7706ef413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:55.057062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1379/2765] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:51:55.061064 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17542-5378-4cc8-bdb3-856652feac88 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.070556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd17542-5378-4cc8-bdb3-856652feac88 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.075281 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.075953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.076728 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.077005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.077726 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:51:55.078030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.079604 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:55.090768 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1387/2766] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:51:55.095307 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985b2bf-6023-4cfb-bb1f-16e7706ef413 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.104272 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985b2bf-6023-4cfb-bb1f-16e7706ef413 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.108957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4b51-d359-4532-8748-4c12650d87a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.109584 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4b51-d359-4532-8748-4c12650d87a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.109865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4b51-d359-4532-8748-4c12650d87a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.110139 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4b51-d359-4532-8748-4c12650d87a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.110825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac4b51-d359-4532-8748-4c12650d87a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.112743 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac4b51-d359-4532-8748-4c12650d87a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:55.126226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:55.209764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1380/2767] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:51:55 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:51:55.213855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.224097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d72a3-9761-40a7-a983-15f2c2015b03 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.267095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:55.279134 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d89e5-9d00-42c8-901b-136a0cb66c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.279795 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d89e5-9d00-42c8-901b-136a0cb66c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.280114 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d89e5-9d00-42c8-901b-136a0cb66c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.280392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d89e5-9d00-42c8-901b-136a0cb66c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.281083 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d89e5-9d00-42c8-901b-136a0cb66c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.282984 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d89e5-9d00-42c8-901b-136a0cb66c27 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:55.372413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1388/2768] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:51:55 2022] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:51:55.376856 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4b51-d359-4532-8748-4c12650d87a0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.387009 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4b51-d359-4532-8748-4c12650d87a0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.392228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa07c1-57d7-4681-b078-7e22d4e92059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.392879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa07c1-57d7-4681-b078-7e22d4e92059 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.393162 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa07c1-57d7-4681-b078-7e22d4e92059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.393702 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa07c1-57d7-4681-b078-7e22d4e92059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.394418 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa07c1-57d7-4681-b078-7e22d4e92059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.396028 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa07c1-57d7-4681-b078-7e22d4e92059 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:55.406258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1381/2769] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:51:55.410142 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d89e5-9d00-42c8-901b-136a0cb66c27 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.419838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d89e5-9d00-42c8-901b-136a0cb66c27 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.424850 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c25909-fd3e-413f-940b-6872cc32fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.425489 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c25909-fd3e-413f-940b-6872cc32fdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.425767 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c25909-fd3e-413f-940b-6872cc32fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.426039 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c25909-fd3e-413f-940b-6872cc32fdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.426754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c25909-fd3e-413f-940b-6872cc32fdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.428371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c25909-fd3e-413f-940b-6872cc32fdb6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:55.439486 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1389/2770] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:51:55.443260 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa07c1-57d7-4681-b078-7e22d4e92059 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.453481 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa07c1-57d7-4681-b078-7e22d4e92059 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.458041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8970d-0698-4c1c-a26e-241644bb9479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.458905 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8970d-0698-4c1c-a26e-241644bb9479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.459182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8970d-0698-4c1c-a26e-241644bb9479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.459453 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8970d-0698-4c1c-a26e-241644bb9479 admin admin] PATH_INFO: `/v3/projects/2e87e59877b7439da9b83b2a06bfed56/users/7e63a5c0d2804d869987c5a5ccb055df/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.473479 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8970d-0698-4c1c-a26e-241644bb9479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e87e59877b7439da9b83b2a06bfed56, user_id=7e63a5c0d2804d869987c5a5ccb055df, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.476067 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8970d-0698-4c1c-a26e-241644bb9479 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:55.534113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1382/2771] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:51:55 2022] PUT /identity/v3/projects/2e87e59877b7439da9b83b2a06bfed56/users/7e63a5c0d2804d869987c5a5ccb055df/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:51:55.545609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a33542-c00e-4e92-8a59-def46d63d162 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.545893 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a33542-c00e-4e92-8a59-def46d63d162 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.546446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a33542-c00e-4e92-8a59-def46d63d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.572260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d9a33542-c00e-4e92-8a59-def46d63d162 None None] MFA Rules not processed for user `7e63a5c0d2804d869987c5a5ccb055df`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:51:55.573442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d9a33542-c00e-4e92-8a59-def46d63d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:55.634777 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1390/2772] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:51:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:51:55.639282 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8970d-0698-4c1c-a26e-241644bb9479 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.702111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8970d-0698-4c1c-a26e-241644bb9479 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.706756 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52078ab-fa0a-463a-a825-7b22f3a2a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.707406 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52078ab-fa0a-463a-a825-7b22f3a2a546 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.707687 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52078ab-fa0a-463a-a825-7b22f3a2a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.707997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52078ab-fa0a-463a-a825-7b22f3a2a546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.708697 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52078ab-fa0a-463a-a825-7b22f3a2a546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.710571 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52078ab-fa0a-463a-a825-7b22f3a2a546 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:55.809576 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1383/2773] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:51:55 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:51:55.814121 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a33542-c00e-4e92-8a59-def46d63d162 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.824787 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a33542-c00e-4e92-8a59-def46d63d162 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.879968 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee2bc9-4c9f-4fdd-a53a-bc1c6b4406c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.880631 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee2bc9-4c9f-4fdd-a53a-bc1c6b4406c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.880914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee2bc9-4c9f-4fdd-a53a-bc1c6b4406c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.881189 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee2bc9-4c9f-4fdd-a53a-bc1c6b4406c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.881900 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee2bc9-4c9f-4fdd-a53a-bc1c6b4406c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.883808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee2bc9-4c9f-4fdd-a53a-bc1c6b4406c9 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:55.968165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1391/2774] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:51:55 2022] POST /identity/v3/users => generated 308 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:51:55.972108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52078ab-fa0a-463a-a825-7b22f3a2a546 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:55.982319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52078ab-fa0a-463a-a825-7b22f3a2a546 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:55.987641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3abd2-942d-498f-92d0-2bdda85abe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:55.988357 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3abd2-942d-498f-92d0-2bdda85abe39 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:55.988693 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3abd2-942d-498f-92d0-2bdda85abe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:55.988916 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3abd2-942d-498f-92d0-2bdda85abe39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:55.989632 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3abd2-942d-498f-92d0-2bdda85abe39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:55.991209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3abd2-942d-498f-92d0-2bdda85abe39 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:56.001511 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1384/2775] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:51:56.005371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee2bc9-4c9f-4fdd-a53a-bc1c6b4406c9 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:56.014947 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee2bc9-4c9f-4fdd-a53a-bc1c6b4406c9 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:56.019707 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cffec-866d-4032-89a6-4d88f2d6ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:56.020574 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cffec-866d-4032-89a6-4d88f2d6ffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:56.020853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cffec-866d-4032-89a6-4d88f2d6ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:56.021124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cffec-866d-4032-89a6-4d88f2d6ffa1 admin admin] PATH_INFO: `/v3/projects/b33a7c17ff094efa9dc53c787ad44731/users/41d1d56cdbb54fb7a26b0caa8b206ab1/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:56.035611 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cffec-866d-4032-89a6-4d88f2d6ffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33a7c17ff094efa9dc53c787ad44731, user_id=41d1d56cdbb54fb7a26b0caa8b206ab1, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:56.038337 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cffec-866d-4032-89a6-4d88f2d6ffa1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:56.094244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1392/2776] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:51:56 2022] PUT /identity/v3/projects/b33a7c17ff094efa9dc53c787ad44731/users/41d1d56cdbb54fb7a26b0caa8b206ab1/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:51:56.098176 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3abd2-942d-498f-92d0-2bdda85abe39 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:56.108629 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3abd2-942d-498f-92d0-2bdda85abe39 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:56.163200 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c93d-60dc-42b2-9fb2-de194c91346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:56.163860 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c93d-60dc-42b2-9fb2-de194c91346c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:56.164171 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c93d-60dc-42b2-9fb2-de194c91346c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:56.164446 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c93d-60dc-42b2-9fb2-de194c91346c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:56.165166 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c93d-60dc-42b2-9fb2-de194c91346c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:56.166805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c93d-60dc-42b2-9fb2-de194c91346c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:56.177020 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1385/2777] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:51:56.181070 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cffec-866d-4032-89a6-4d88f2d6ffa1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:56.191085 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cffec-866d-4032-89a6-4d88f2d6ffa1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:56.195583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:56.196544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:56.196822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:56.197095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] PATH_INFO: `/v3/projects/b33a7c17ff094efa9dc53c787ad44731/users/41d1d56cdbb54fb7a26b0caa8b206ab1/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:56.199026 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33a7c17ff094efa9dc53c787ad44731, user_id=41d1d56cdbb54fb7a26b0caa8b206ab1, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:56.201666 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:56.211832 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1393/2778] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:51:56 2022] PUT /identity/v3/projects/b33a7c17ff094efa9dc53c787ad44731/users/41d1d56cdbb54fb7a26b0caa8b206ab1/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:51:56.221966 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265086-12f5-43f9-a297-ad3fb53a5183 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:56.222253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265086-12f5-43f9-a297-ad3fb53a5183 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:56.222527 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265086-12f5-43f9-a297-ad3fb53a5183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:56.249399 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-64265086-12f5-43f9-a297-ad3fb53a5183 None None] MFA Rules not processed for user `41d1d56cdbb54fb7a26b0caa8b206ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:51:56.250534 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-64265086-12f5-43f9-a297-ad3fb53a5183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:56.269101 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:56.316564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1386/2779] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:51:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:51:56.327379 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:56.329117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:56.338670 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:56.386219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7f602-0288-4011-85ea-f36ac42731d4 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:56.390342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9e4df-2f77-4594-aac1-48a7f1e89cee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:56.390965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9e4df-2f77-4594-aac1-48a7f1e89cee service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:56.391244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9e4df-2f77-4594-aac1-48a7f1e89cee service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:56.391515 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9e4df-2f77-4594-aac1-48a7f1e89cee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:56.400472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9e4df-2f77-4594-aac1-48a7f1e89cee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:56.402219 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9e4df-2f77-4594-aac1-48a7f1e89cee service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:56.412441 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1394/2780] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:51:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:51:56.563441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64265086-12f5-43f9-a297-ad3fb53a5183 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:56.624184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64265086-12f5-43f9-a297-ad3fb53a5183 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:56.628705 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:56.629592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:56.629877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:56.630154 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] PATH_INFO: `/v3/users/7e63a5c0d2804d869987c5a5ccb055df` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:56.631362 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e63a5c0d2804d869987c5a5ccb055df)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:56.633356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:56.838929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e63a5c0d2804d869987c5a5ccb055df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:56.916203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e63a5c0d2804d869987c5a5ccb055df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:56.928253 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e63a5c0d2804d869987c5a5ccb055df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:56.928877 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e63a5c0d2804d869987c5a5ccb055df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:56.936062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e63a5c0d2804d869987c5a5ccb055df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:56.941904 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1387/2781] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:51:56 2022] DELETE /identity/v3/users/7e63a5c0d2804d869987c5a5ccb055df => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:51:56.946520 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355b3e-fa80-48f1-9c9e-ddc75916df7a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:56.946804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355b3e-fa80-48f1-9c9e-ddc75916df7a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:56.947079 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355b3e-fa80-48f1-9c9e-ddc75916df7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:56.964301 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-1a355b3e-fa80-48f1-9c9e-ddc75916df7a None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:51:56.965484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a355b3e-fa80-48f1-9c9e-ddc75916df7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:57.022289 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1395/2782] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:51:57.031899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:57.033308 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:57.072633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:57.088850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bec41-d10a-4717-86c3-5724d3b6c111 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:57.092489 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfaeb8-2b09-4b0b-b49b-afa8322e1d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:57.093069 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfaeb8-2b09-4b0b-b49b-afa8322e1d3d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:57.093352 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfaeb8-2b09-4b0b-b49b-afa8322e1d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:57.093628 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfaeb8-2b09-4b0b-b49b-afa8322e1d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:57.102321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfaeb8-2b09-4b0b-b49b-afa8322e1d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:57.103747 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfaeb8-2b09-4b0b-b49b-afa8322e1d3d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:57.114001 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1388/2783] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:51:57.552319 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355b3e-fa80-48f1-9c9e-ddc75916df7a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:57.553816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-1a355b3e-fa80-48f1-9c9e-ddc75916df7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:57.566131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355b3e-fa80-48f1-9c9e-ddc75916df7a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:57.571156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:57.572255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:57.572540 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:57.572871 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] PATH_INFO: `/v3/projects/2e87e59877b7439da9b83b2a06bfed56` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:57.574063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e87e59877b7439da9b83b2a06bfed56)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:57.575994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:57.682007 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e87e59877b7439da9b83b2a06bfed56', 'request_id': 'req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:57.687377 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e87e59877b7439da9b83b2a06bfed56', 'request_id': 'req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:57.693357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e87e59877b7439da9b83b2a06bfed56', 'request_id': 'req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:57.785153 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] The token cache is being invalidate because project 2e87e59877b7439da9b83b2a06bfed56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:51:57.785446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:57.786068 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:57.787601 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1396/2784] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:51:57 2022] DELETE /identity/v3/projects/2e87e59877b7439da9b83b2a06bfed56 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:51:57.791646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfaeb8-2b09-4b0b-b49b-afa8322e1d3d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:57.801294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfaeb8-2b09-4b0b-b49b-afa8322e1d3d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:57.855530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:57.856419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:57.856695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:57.856967 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] PATH_INFO: `/v3/users/41d1d56cdbb54fb7a26b0caa8b206ab1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:57.858157 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d1d56cdbb54fb7a26b0caa8b206ab1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:57.860089 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:58.010024 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d1d56cdbb54fb7a26b0caa8b206ab1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.058898 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d1d56cdbb54fb7a26b0caa8b206ab1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.070912 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d1d56cdbb54fb7a26b0caa8b206ab1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.071551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d1d56cdbb54fb7a26b0caa8b206ab1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.078845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-13f60fea-b58b-4da7-bcff-28f5bcbf29d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d1d56cdbb54fb7a26b0caa8b206ab1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.084780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1389/2785] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:51:57 2022] DELETE /identity/v3/users/41d1d56cdbb54fb7a26b0caa8b206ab1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:51:58.523817 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:58.525329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:58.539901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e7de0-98ef-423f-b959-4f8bb4f5f656 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:58.569612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:58.594579 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:58.595425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:58.595705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:58.596017 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] PATH_INFO: `/v3/projects/b33a7c17ff094efa9dc53c787ad44731` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:58.597174 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33a7c17ff094efa9dc53c787ad44731)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:58.599088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:58.739748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33a7c17ff094efa9dc53c787ad44731', 'request_id': 'req-904e7c3c-3810-476d-8f83-619c7e0e199f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.745223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33a7c17ff094efa9dc53c787ad44731', 'request_id': 'req-904e7c3c-3810-476d-8f83-619c7e0e199f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.751994 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33a7c17ff094efa9dc53c787ad44731', 'request_id': 'req-904e7c3c-3810-476d-8f83-619c7e0e199f'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.829800 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] The token cache is being invalidate because project b33a7c17ff094efa9dc53c787ad44731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:51:58.829995 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.830626 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-904e7c3c-3810-476d-8f83-619c7e0e199f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:51:58.832166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1397/2786] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:51:58 2022] DELETE /identity/v3/projects/b33a7c17ff094efa9dc53c787ad44731 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:51:58.837019 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d992cf-5e99-425c-a63d-6a870decc97b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:58.837303 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d992cf-5e99-425c-a63d-6a870decc97b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:58.842602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d992cf-5e99-425c-a63d-6a870decc97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:58.855608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-07d992cf-5e99-425c-a63d-6a870decc97b None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:51:58.856830 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-07d992cf-5e99-425c-a63d-6a870decc97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:58.907108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:58.916228 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1390/2787] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:51:58.924550 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6a51-82a9-45a7-beaf-04c362dbccab None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:58.924838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6a51-82a9-45a7-beaf-04c362dbccab None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:58.925144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6a51-82a9-45a7-beaf-04c362dbccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:58.942962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-142f6a51-82a9-45a7-beaf-04c362dbccab None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:51:58.944175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-142f6a51-82a9-45a7-beaf-04c362dbccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:58.951943 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1398/2788] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:51:58.955930 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d992cf-5e99-425c-a63d-6a870decc97b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:58.965372 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d992cf-5e99-425c-a63d-6a870decc97b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:58.970953 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:58.971597 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:58.971879 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:58.972183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:58.972929 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:51:58.973234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:58.974819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:58.986774 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1391/2789] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:51:58.990776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f6a51-82a9-45a7-beaf-04c362dbccab None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:58.999793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f6a51-82a9-45a7-beaf-04c362dbccab None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.004333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32fec-b681-43de-bc40-0ec32d63db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.004962 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32fec-b681-43de-bc40-0ec32d63db3e admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.005239 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32fec-b681-43de-bc40-0ec32d63db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.005563 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32fec-b681-43de-bc40-0ec32d63db3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.006242 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32fec-b681-43de-bc40-0ec32d63db3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:59.008125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32fec-b681-43de-bc40-0ec32d63db3e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:59.117120 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1399/2790] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:51:58 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:51:59.121268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:59.131182 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f6763-1960-4e56-a910-fa3f799457ea admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.188181 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85979d-700d-402d-b046-bc987ab1ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.188840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85979d-700d-402d-b046-bc987ab1ddb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.189119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85979d-700d-402d-b046-bc987ab1ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.189390 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85979d-700d-402d-b046-bc987ab1ddb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.190068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85979d-700d-402d-b046-bc987ab1ddb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:59.191993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85979d-700d-402d-b046-bc987ab1ddb8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:59.265209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1392/2791] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:51:59 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:51:59.269687 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32fec-b681-43de-bc40-0ec32d63db3e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:59.280678 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32fec-b681-43de-bc40-0ec32d63db3e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.285493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c16a-a6db-43f6-94a9-5df567effeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.286156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c16a-a6db-43f6-94a9-5df567effeeb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.286438 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c16a-a6db-43f6-94a9-5df567effeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.286757 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c16a-a6db-43f6-94a9-5df567effeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.287499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84c16a-a6db-43f6-94a9-5df567effeeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:59.289106 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84c16a-a6db-43f6-94a9-5df567effeeb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:59.299673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1400/2792] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:51:59.303700 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85979d-700d-402d-b046-bc987ab1ddb8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:59.313547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85979d-700d-402d-b046-bc987ab1ddb8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.318075 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd2146-2a6c-4b35-830a-54ea310a6a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.318716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd2146-2a6c-4b35-830a-54ea310a6a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.318995 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd2146-2a6c-4b35-830a-54ea310a6a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.319267 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd2146-2a6c-4b35-830a-54ea310a6a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.320013 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd2146-2a6c-4b35-830a-54ea310a6a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:59.321602 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd2146-2a6c-4b35-830a-54ea310a6a33 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:59.331712 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1393/2793] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:51:59.335543 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c16a-a6db-43f6-94a9-5df567effeeb admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:59.345839 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c16a-a6db-43f6-94a9-5df567effeeb admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.350392 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17a089-a774-4aeb-9f65-f72c5939713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.351247 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17a089-a774-4aeb-9f65-f72c5939713e admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.351532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17a089-a774-4aeb-9f65-f72c5939713e admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.351805 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17a089-a774-4aeb-9f65-f72c5939713e admin admin] PATH_INFO: `/v3/projects/3fe08f53152e4cec9472d3256e94658c/users/026cbe75b90443cbaabe78d14cc7e6ac/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.365754 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17a089-a774-4aeb-9f65-f72c5939713e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe08f53152e4cec9472d3256e94658c, user_id=026cbe75b90443cbaabe78d14cc7e6ac, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:59.368459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17a089-a774-4aeb-9f65-f72c5939713e admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:59.458357 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1401/2794] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:51:59 2022] PUT /identity/v3/projects/3fe08f53152e4cec9472d3256e94658c/users/026cbe75b90443cbaabe78d14cc7e6ac/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:51:59.470207 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5041-3d38-4dc8-855e-c7642f0c5ca1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.470493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5041-3d38-4dc8-855e-c7642f0c5ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.470764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5041-3d38-4dc8-855e-c7642f0c5ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.497135 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f83c5041-3d38-4dc8-855e-c7642f0c5ca1 None None] MFA Rules not processed for user `026cbe75b90443cbaabe78d14cc7e6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:51:59.498356 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f83c5041-3d38-4dc8-855e-c7642f0c5ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:51:59.560124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1394/2795] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:51:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:51:59.564781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17a089-a774-4aeb-9f65-f72c5939713e admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:59.624423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17a089-a774-4aeb-9f65-f72c5939713e admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.628930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60da7-bf95-41d2-9868-6ec763b48e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.629575 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60da7-bf95-41d2-9868-6ec763b48e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.629857 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60da7-bf95-41d2-9868-6ec763b48e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.630132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60da7-bf95-41d2-9868-6ec763b48e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.630811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60da7-bf95-41d2-9868-6ec763b48e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:59.632735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60da7-bf95-41d2-9868-6ec763b48e5b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:59.635890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:59.740992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1402/2796] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:51:59 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:51:59.745044 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5041-3d38-4dc8-855e-c7642f0c5ca1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:59.756430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5041-3d38-4dc8-855e-c7642f0c5ca1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.804467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:51:59.813902 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe8c8-4a8c-4b3d-bc81-000df5177e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.814560 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe8c8-4a8c-4b3d-bc81-000df5177e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.814845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe8c8-4a8c-4b3d-bc81-000df5177e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.815122 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfe8c8-4a8c-4b3d-bc81-000df5177e2b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.815814 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfe8c8-4a8c-4b3d-bc81-000df5177e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:59.817777 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfe8c8-4a8c-4b3d-bc81-000df5177e2b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:59.939866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1395/2797] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:51:59 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:51:59.944024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60da7-bf95-41d2-9868-6ec763b48e5b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:59.954682 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60da7-bf95-41d2-9868-6ec763b48e5b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.959049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f1ae7-8279-4477-9a92-fa72c4d3ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.959692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1ae7-8279-4477-9a92-fa72c4d3ed3a admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.960006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1ae7-8279-4477-9a92-fa72c4d3ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.960283 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f1ae7-8279-4477-9a92-fa72c4d3ed3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:51:59.961027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f1ae7-8279-4477-9a92-fa72c4d3ed3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:51:59.962605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f1ae7-8279-4477-9a92-fa72c4d3ed3a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:51:59.972772 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1403/2798] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:51:59.976720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe8c8-4a8c-4b3d-bc81-000df5177e2b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:51:59.986405 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfe8c8-4a8c-4b3d-bc81-000df5177e2b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:51:59.990932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c929109-adc2-44c2-b2ca-3d8a5d90fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:51:59.991793 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929109-adc2-44c2-b2ca-3d8a5d90fc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:51:59.992105 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929109-adc2-44c2-b2ca-3d8a5d90fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:51:59.992379 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c929109-adc2-44c2-b2ca-3d8a5d90fc08 admin admin] PATH_INFO: `/v3/projects/3ca13e84e30a4a6fae34653fe1e234e4/users/dff06781160a4490a107112062c431f0/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:00.007293 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c929109-adc2-44c2-b2ca-3d8a5d90fc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca13e84e30a4a6fae34653fe1e234e4, user_id=dff06781160a4490a107112062c431f0, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:00.010030 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c929109-adc2-44c2-b2ca-3d8a5d90fc08 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:00.080764 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1396/2799] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:51:59 2022] PUT /identity/v3/projects/3ca13e84e30a4a6fae34653fe1e234e4/users/dff06781160a4490a107112062c431f0/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:00.084766 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f1ae7-8279-4477-9a92-fa72c4d3ed3a admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:00.094535 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f1ae7-8279-4477-9a92-fa72c4d3ed3a admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:00.148658 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d878-58c7-4b29-b1da-882186501db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:00.149311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d878-58c7-4b29-b1da-882186501db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:00.149585 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d878-58c7-4b29-b1da-882186501db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:00.149863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d878-58c7-4b29-b1da-882186501db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:00.150637 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439d878-58c7-4b29-b1da-882186501db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:00.152259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439d878-58c7-4b29-b1da-882186501db4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:00.161602 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1404/2800] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:00.165714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c929109-adc2-44c2-b2ca-3d8a5d90fc08 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:00.176249 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c929109-adc2-44c2-b2ca-3d8a5d90fc08 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:00.180873 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:00.181769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:00.182051 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:00.182329 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] PATH_INFO: `/v3/projects/3ca13e84e30a4a6fae34653fe1e234e4/users/dff06781160a4490a107112062c431f0/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:00.184353 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca13e84e30a4a6fae34653fe1e234e4, user_id=dff06781160a4490a107112062c431f0, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:00.187623 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:00.197810 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1397/2801] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:52:00 2022] PUT /identity/v3/projects/3ca13e84e30a4a6fae34653fe1e234e4/users/dff06781160a4490a107112062c431f0/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:00.207810 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c63a-f408-4e6b-a0a5-a7a048d429bb None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:00.208157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c63a-f408-4e6b-a0a5-a7a048d429bb None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:00.208440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c63a-f408-4e6b-a0a5-a7a048d429bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:00.236044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-fe69c63a-f408-4e6b-a0a5-a7a048d429bb None None] MFA Rules not processed for user `dff06781160a4490a107112062c431f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:00.239173 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-fe69c63a-f408-4e6b-a0a5-a7a048d429bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:00.303230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1405/2802] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:00.314936 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:00.316647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:00.372243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3b016-e108-4fda-b80b-dc5dccb3c062 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:00.375847 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89331f66-d5c5-4437-9fdd-f138b820011c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:00.376510 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89331f66-d5c5-4437-9fdd-f138b820011c service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:00.376789 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89331f66-d5c5-4437-9fdd-f138b820011c service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:00.377062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89331f66-d5c5-4437-9fdd-f138b820011c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:00.385998 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89331f66-d5c5-4437-9fdd-f138b820011c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:00.387411 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89331f66-d5c5-4437-9fdd-f138b820011c service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:00.397470 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1398/2803] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:00.424776 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69c63a-f408-4e6b-a0a5-a7a048d429bb None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:00.479761 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:00.484948 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69c63a-f408-4e6b-a0a5-a7a048d429bb None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:00.489439 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:00.490284 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:00.490564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:00.490932 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] PATH_INFO: `/v3/users/026cbe75b90443cbaabe78d14cc7e6ac` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:00.492131 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026cbe75b90443cbaabe78d14cc7e6ac)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:00.494027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:00.637701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026cbe75b90443cbaabe78d14cc7e6ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:00.645317 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026cbe75b90443cbaabe78d14cc7e6ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:00.722136 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026cbe75b90443cbaabe78d14cc7e6ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:00.722760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026cbe75b90443cbaabe78d14cc7e6ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:00.736906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026cbe75b90443cbaabe78d14cc7e6ac'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:00.742807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1406/2804] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:52:00 2022] DELETE /identity/v3/users/026cbe75b90443cbaabe78d14cc7e6ac => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:00.747771 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbbe8a-c8c1-48d8-82ba-0a692e120bbd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:00.748578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbbe8a-c8c1-48d8-82ba-0a692e120bbd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:00.748853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbbe8a-c8c1-48d8-82ba-0a692e120bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:00.766981 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-93bbbe8a-c8c1-48d8-82ba-0a692e120bbd None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:00.768219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-93bbbe8a-c8c1-48d8-82ba-0a692e120bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:00.824722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1399/2805] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:00.834253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:00.835613 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:00.892505 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b646a-e418-45d6-9105-71ad70f28193 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:00.896411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b6f9-a30c-4c40-9c68-922c87818b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:00.897051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b6f9-a30c-4c40-9c68-922c87818b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:00.897334 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b6f9-a30c-4c40-9c68-922c87818b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:00.897609 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b6f9-a30c-4c40-9c68-922c87818b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:00.906422 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1b6f9-a30c-4c40-9c68-922c87818b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:00.907844 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1b6f9-a30c-4c40-9c68-922c87818b55 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:00.917282 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1407/2806] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:01.335045 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbbe8a-c8c1-48d8-82ba-0a692e120bbd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:01.336530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-93bbbe8a-c8c1-48d8-82ba-0a692e120bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:01.349633 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbbe8a-c8c1-48d8-82ba-0a692e120bbd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:01.354505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:01.355365 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:01.355653 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:01.355955 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] PATH_INFO: `/v3/projects/3fe08f53152e4cec9472d3256e94658c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:01.357148 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe08f53152e4cec9472d3256e94658c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:01.359851 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:01.479442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:01.483734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe08f53152e4cec9472d3256e94658c', 'request_id': 'req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.489155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe08f53152e4cec9472d3256e94658c', 'request_id': 'req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.495226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe08f53152e4cec9472d3256e94658c', 'request_id': 'req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.583971 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] The token cache is being invalidate because project 3fe08f53152e4cec9472d3256e94658c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:52:01.584224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.584840 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.586388 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1400/2807] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:52:01 2022] DELETE /identity/v3/projects/3fe08f53152e4cec9472d3256e94658c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:01.590494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b6f9-a30c-4c40-9c68-922c87818b55 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:01.600493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b6f9-a30c-4c40-9c68-922c87818b55 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:01.655241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:01.656125 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:01.656406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:01.656679 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] PATH_INFO: `/v3/users/dff06781160a4490a107112062c431f0` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:01.658100 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff06781160a4490a107112062c431f0)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:01.659760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:01.679885 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:01.860582 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff06781160a4490a107112062c431f0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.867263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff06781160a4490a107112062c431f0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.910720 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff06781160a4490a107112062c431f0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.911459 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff06781160a4490a107112062c431f0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.923302 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-b64b57e8-d0bd-4657-bfe8-65763312c31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff06781160a4490a107112062c431f0'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:01.929830 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1408/2808] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:52:01 2022] DELETE /identity/v3/users/dff06781160a4490a107112062c431f0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:02.267097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:02.268944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:02.282910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdbd20-26b5-4bae-88ff-0aa85f2d32a4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:02.340181 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:02.341047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:02.341335 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:02.341617 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] PATH_INFO: `/v3/projects/3ca13e84e30a4a6fae34653fe1e234e4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:02.342801 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca13e84e30a4a6fae34653fe1e234e4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:02.344744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:02.436786 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca13e84e30a4a6fae34653fe1e234e4', 'request_id': 'req-8229604e-76ba-425f-a0e2-48d84dbb561c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:02.442167 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca13e84e30a4a6fae34653fe1e234e4', 'request_id': 'req-8229604e-76ba-425f-a0e2-48d84dbb561c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:02.448153 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca13e84e30a4a6fae34653fe1e234e4', 'request_id': 'req-8229604e-76ba-425f-a0e2-48d84dbb561c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:02.509894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] The token cache is being invalidate because project 3ca13e84e30a4a6fae34653fe1e234e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:52:02.510183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:02.510799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8229604e-76ba-425f-a0e2-48d84dbb561c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:02.512382 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1401/2809] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:52:02 2022] DELETE /identity/v3/projects/3ca13e84e30a4a6fae34653fe1e234e4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:02.517243 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22ea9a-1352-4a72-80c5-6d9aff14c441 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:02.517529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22ea9a-1352-4a72-80c5-6d9aff14c441 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:02.517808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22ea9a-1352-4a72-80c5-6d9aff14c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:02.536264 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-3a22ea9a-1352-4a72-80c5-6d9aff14c441 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:02.537484 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3a22ea9a-1352-4a72-80c5-6d9aff14c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:02.596665 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1409/2810] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:02.604212 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2fb2f-8e8a-4f26-b06c-7504326173c2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:02.604525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2fb2f-8e8a-4f26-b06c-7504326173c2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:02.604808 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2fb2f-8e8a-4f26-b06c-7504326173c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:02.624029 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-83a2fb2f-8e8a-4f26-b06c-7504326173c2 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:02.625227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-83a2fb2f-8e8a-4f26-b06c-7504326173c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:02.633152 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1402/2811] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:02.637256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22ea9a-1352-4a72-80c5-6d9aff14c441 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:02.647024 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22ea9a-1352-4a72-80c5-6d9aff14c441 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:02.651472 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:02.652143 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:02.652423 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:02.652694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:02.653417 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:52:02.653720 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:02.655793 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:02.667084 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1410/2812] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:52:02.671932 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2fb2f-8e8a-4f26-b06c-7504326173c2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:02.681184 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2fb2f-8e8a-4f26-b06c-7504326173c2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:02.685903 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d74d6-40bf-4875-b66f-2657c6757ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:02.687457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d74d6-40bf-4875-b66f-2657c6757ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:02.687457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d74d6-40bf-4875-b66f-2657c6757ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:02.687457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d74d6-40bf-4875-b66f-2657c6757ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:02.687788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d74d6-40bf-4875-b66f-2657c6757ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:02.689720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d74d6-40bf-4875-b66f-2657c6757ebb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:02.773580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1403/2813] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:52:02 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:52:02.898122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:02.898122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f4e51-ee99-4fe9-acd1-c7fb9d5c9272 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:02.898122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625475c-7f3c-4547-9c6e-9e253761115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:02.898122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625475c-7f3c-4547-9c6e-9e253761115b admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:02.898600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625475c-7f3c-4547-9c6e-9e253761115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:02.898600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625475c-7f3c-4547-9c6e-9e253761115b admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:02.898600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625475c-7f3c-4547-9c6e-9e253761115b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:02.898600 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625475c-7f3c-4547-9c6e-9e253761115b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:02.968988 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1411/2814] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:52:02 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:52:02.981454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d74d6-40bf-4875-b66f-2657c6757ebb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:02.992466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d74d6-40bf-4875-b66f-2657c6757ebb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:02.997306 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8550c-3442-47b4-b435-9917d5d4998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:02.997977 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8550c-3442-47b4-b435-9917d5d4998f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:02.998257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8550c-3442-47b4-b435-9917d5d4998f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:02.998526 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8550c-3442-47b4-b435-9917d5d4998f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:02.999236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8550c-3442-47b4-b435-9917d5d4998f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.000919 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8550c-3442-47b4-b435-9917d5d4998f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.012722 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1404/2815] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:03.017034 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625475c-7f3c-4547-9c6e-9e253761115b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:03.027504 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625475c-7f3c-4547-9c6e-9e253761115b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:03.032958 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d39d85-0b17-4c48-a473-e4935b92eac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:03.033719 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39d85-0b17-4c48-a473-e4935b92eac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.034057 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39d85-0b17-4c48-a473-e4935b92eac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.034497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39d85-0b17-4c48-a473-e4935b92eac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.035290 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d39d85-0b17-4c48-a473-e4935b92eac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.036971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d39d85-0b17-4c48-a473-e4935b92eac4 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.047316 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1412/2816] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:03.051512 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8550c-3442-47b4-b435-9917d5d4998f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:03.061785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8550c-3442-47b4-b435-9917d5d4998f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:03.066316 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871af6-e702-42b4-bb24-2cfa1a93c7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:03.067191 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871af6-e702-42b4-bb24-2cfa1a93c7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.067471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871af6-e702-42b4-bb24-2cfa1a93c7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.067741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871af6-e702-42b4-bb24-2cfa1a93c7a3 admin admin] PATH_INFO: `/v3/projects/38c7aead193d40e995e7ac3e2fdf796c/users/c3e6ee1ee3aa44b480a2dcc04467254c/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.082755 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871af6-e702-42b4-bb24-2cfa1a93c7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c7aead193d40e995e7ac3e2fdf796c, user_id=c3e6ee1ee3aa44b480a2dcc04467254c, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.085445 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871af6-e702-42b4-bb24-2cfa1a93c7a3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.180213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:03.186509 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1405/2817] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:52:03 2022] PUT /identity/v3/projects/38c7aead193d40e995e7ac3e2fdf796c/users/c3e6ee1ee3aa44b480a2dcc04467254c/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:52:03.197344 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0448-3c37-41e6-9309-41b94974fefd None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.197635 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0448-3c37-41e6-9309-41b94974fefd None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.197911 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0448-3c37-41e6-9309-41b94974fefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.204150 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:03.225426 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c38e0448-3c37-41e6-9309-41b94974fefd None None] MFA Rules not processed for user `c3e6ee1ee3aa44b480a2dcc04467254c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:03.226541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c38e0448-3c37-41e6-9309-41b94974fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:03.288141 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1413/2818] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:03.292559 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871af6-e702-42b4-bb24-2cfa1a93c7a3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:03.353525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871af6-e702-42b4-bb24-2cfa1a93c7a3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:03.358254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc608d32-f00b-4fff-ac6d-0a989b4e29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:03.358908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc608d32-f00b-4fff-ac6d-0a989b4e29c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.359192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc608d32-f00b-4fff-ac6d-0a989b4e29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.359471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc608d32-f00b-4fff-ac6d-0a989b4e29c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.360223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc608d32-f00b-4fff-ac6d-0a989b4e29c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.362116 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc608d32-f00b-4fff-ac6d-0a989b4e29c8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.436451 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1406/2819] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:52:03 2022] POST /identity/v3/projects => generated 401 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:52:03.440541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e0448-3c37-41e6-9309-41b94974fefd None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:03.451746 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e0448-3c37-41e6-9309-41b94974fefd None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:03.505877 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847da5b-2b0a-44c5-9b0a-bb40f9fe8cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:03.506475 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847da5b-2b0a-44c5-9b0a-bb40f9fe8cae admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.506763 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847da5b-2b0a-44c5-9b0a-bb40f9fe8cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.507043 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847da5b-2b0a-44c5-9b0a-bb40f9fe8cae admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.507781 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847da5b-2b0a-44c5-9b0a-bb40f9fe8cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.509774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847da5b-2b0a-44c5-9b0a-bb40f9fe8cae admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.636387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1414/2820] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:52:03 2022] POST /identity/v3/users => generated 307 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:52:03.641124 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc608d32-f00b-4fff-ac6d-0a989b4e29c8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:03.651466 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc608d32-f00b-4fff-ac6d-0a989b4e29c8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:03.655975 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199c8c-c9ba-471d-b6d8-af45e064d36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:03.656626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199c8c-c9ba-471d-b6d8-af45e064d36d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.656906 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199c8c-c9ba-471d-b6d8-af45e064d36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.657179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199c8c-c9ba-471d-b6d8-af45e064d36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.657897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a199c8c-c9ba-471d-b6d8-af45e064d36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.659469 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a199c8c-c9ba-471d-b6d8-af45e064d36d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.669843 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1407/2821] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:03.673845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847da5b-2b0a-44c5-9b0a-bb40f9fe8cae admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:03.683808 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847da5b-2b0a-44c5-9b0a-bb40f9fe8cae admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:03.689019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e480688-42f5-4885-b786-167a76a0a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:03.689881 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e480688-42f5-4885-b786-167a76a0a3da admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.690161 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e480688-42f5-4885-b786-167a76a0a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.690431 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e480688-42f5-4885-b786-167a76a0a3da admin admin] PATH_INFO: `/v3/projects/be9352d59f7b4ebebd94319448e70d6b/users/40edf49a23a54ebdab2053d92e9ad94a/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.706573 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e480688-42f5-4885-b786-167a76a0a3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9352d59f7b4ebebd94319448e70d6b, user_id=40edf49a23a54ebdab2053d92e9ad94a, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.709280 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e480688-42f5-4885-b786-167a76a0a3da admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.774069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1415/2822] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:52:03 2022] PUT /identity/v3/projects/be9352d59f7b4ebebd94319448e70d6b/users/40edf49a23a54ebdab2053d92e9ad94a/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:52:03.778052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199c8c-c9ba-471d-b6d8-af45e064d36d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:03.788014 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199c8c-c9ba-471d-b6d8-af45e064d36d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:03.843245 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a072c4-161d-471d-8be4-35c73ac80c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:03.843897 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a072c4-161d-471d-8be4-35c73ac80c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.844213 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a072c4-161d-471d-8be4-35c73ac80c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.844484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a072c4-161d-471d-8be4-35c73ac80c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.845193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a072c4-161d-471d-8be4-35c73ac80c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.846761 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a072c4-161d-471d-8be4-35c73ac80c11 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.856241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1408/2823] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:03.860774 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e480688-42f5-4885-b786-167a76a0a3da admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:03.870784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e480688-42f5-4885-b786-167a76a0a3da admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:03.875987 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:03.876819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.877101 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.877375 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] PATH_INFO: `/v3/projects/be9352d59f7b4ebebd94319448e70d6b/users/40edf49a23a54ebdab2053d92e9ad94a/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.879300 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9352d59f7b4ebebd94319448e70d6b, user_id=40edf49a23a54ebdab2053d92e9ad94a, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:03.881919 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:03.891884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1416/2824] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:52:03 2022] PUT /identity/v3/projects/be9352d59f7b4ebebd94319448e70d6b/users/40edf49a23a54ebdab2053d92e9ad94a/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:03.901948 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641057f0-86f0-4f23-a598-09c6aa250f2b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:03.902233 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641057f0-86f0-4f23-a598-09c6aa250f2b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:03.902507 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641057f0-86f0-4f23-a598-09c6aa250f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:03.927842 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-641057f0-86f0-4f23-a598-09c6aa250f2b None None] MFA Rules not processed for user `40edf49a23a54ebdab2053d92e9ad94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:03.929052 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-641057f0-86f0-4f23-a598-09c6aa250f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:03.986442 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:03.996410 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1409/2825] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:04.007751 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:04.009433 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:04.054649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:04.070662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06ca1-3ec7-4b8f-bed8-24469ac9cc81 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:04.070662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26863c4-6e2d-4cfb-a856-fffacbe31370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:04.070662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26863c4-6e2d-4cfb-a856-fffacbe31370 service cinder] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:04.070990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26863c4-6e2d-4cfb-a856-fffacbe31370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:04.070990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26863c4-6e2d-4cfb-a856-fffacbe31370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:04.079735 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26863c4-6e2d-4cfb-a856-fffacbe31370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:04.081248 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26863c4-6e2d-4cfb-a856-fffacbe31370 service cinder] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:04.090496 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1417/2826] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:04.251257 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641057f0-86f0-4f23-a598-09c6aa250f2b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:04.260999 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641057f0-86f0-4f23-a598-09c6aa250f2b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:04.264612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06157b2d-bd17-42fc-977e-baed79758b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4033fb5bc0624281a97a979a75ce13e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:04.265243 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157b2d-bd17-42fc-977e-baed79758b88 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:04.265525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157b2d-bd17-42fc-977e-baed79758b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:04.265805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157b2d-bd17-42fc-977e-baed79758b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:04.322328 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06157b2d-bd17-42fc-977e-baed79758b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:04.323684 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06157b2d-bd17-42fc-977e-baed79758b88 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:04.332741 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1410/2827] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:09.031307 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26863c4-6e2d-4cfb-a856-fffacbe31370 service cinder] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:09.090643 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26863c4-6e2d-4cfb-a856-fffacbe31370 service cinder] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:09.095072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:09.095926 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:09.096213 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:09.096483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] PATH_INFO: `/v3/users/c3e6ee1ee3aa44b480a2dcc04467254c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:09.097633 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e6ee1ee3aa44b480a2dcc04467254c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:09.099514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:09.271488 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e6ee1ee3aa44b480a2dcc04467254c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:09.278060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e6ee1ee3aa44b480a2dcc04467254c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:09.343823 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e6ee1ee3aa44b480a2dcc04467254c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:09.344550 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e6ee1ee3aa44b480a2dcc04467254c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:09.356399 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e6ee1ee3aa44b480a2dcc04467254c'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:09.362819 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1418/2828] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:52:09 2022] DELETE /identity/v3/users/c3e6ee1ee3aa44b480a2dcc04467254c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:09.370555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffda757-c4dc-4316-bf67-519636eb777c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:09.370555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffda757-c4dc-4316-bf67-519636eb777c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:09.370555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffda757-c4dc-4316-bf67-519636eb777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:09.384821 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0ffda757-c4dc-4316-bf67-519636eb777c None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:09.386007 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0ffda757-c4dc-4316-bf67-519636eb777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:09.444276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1411/2829] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:09.453852 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:09.455386 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:09.511918 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0274f-3113-44ba-9ae5-38beef5b38c3 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:09.515845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1250a-3574-4db8-ac8a-a340dad455ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:09.516583 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1250a-3574-4db8-ac8a-a340dad455ab service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:09.516863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1250a-3574-4db8-ac8a-a340dad455ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:09.517137 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1250a-3574-4db8-ac8a-a340dad455ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:09.526890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1250a-3574-4db8-ac8a-a340dad455ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:09.528314 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1250a-3574-4db8-ac8a-a340dad455ab service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:09.538156 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1419/2830] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:09.933577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffda757-c4dc-4316-bf67-519636eb777c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:09.935031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0ffda757-c4dc-4316-bf67-519636eb777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:09.947583 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffda757-c4dc-4316-bf67-519636eb777c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:09.952326 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:09.953704 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:09.953954 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:09.954224 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] PATH_INFO: `/v3/projects/38c7aead193d40e995e7ac3e2fdf796c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:09.955556 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c7aead193d40e995e7ac3e2fdf796c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:09.958202 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:10.068646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c7aead193d40e995e7ac3e2fdf796c', 'request_id': 'req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.073878 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c7aead193d40e995e7ac3e2fdf796c', 'request_id': 'req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.080500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c7aead193d40e995e7ac3e2fdf796c', 'request_id': 'req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.149493 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] The token cache is being invalidate because project 38c7aead193d40e995e7ac3e2fdf796c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:52:10.149775 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.150391 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.151947 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1412/2831] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:52:09 2022] DELETE /identity/v3/projects/38c7aead193d40e995e7ac3e2fdf796c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:10.156069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1250a-3574-4db8-ac8a-a340dad455ab service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:10.165659 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1250a-3574-4db8-ac8a-a340dad455ab service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:10.170132 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:10.220907 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:10.221760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:10.222042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:10.222318 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] PATH_INFO: `/v3/users/40edf49a23a54ebdab2053d92e9ad94a` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:10.223494 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=40edf49a23a54ebdab2053d92e9ad94a)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:10.225432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:10.403480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40edf49a23a54ebdab2053d92e9ad94a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.410225 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40edf49a23a54ebdab2053d92e9ad94a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.475387 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40edf49a23a54ebdab2053d92e9ad94a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.476032 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40edf49a23a54ebdab2053d92e9ad94a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.488836 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-ab14fbf4-c0f3-432e-b813-702b61440ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40edf49a23a54ebdab2053d92e9ad94a'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:10.494706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1420/2832] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:52:10 2022] DELETE /identity/v3/users/40edf49a23a54ebdab2053d92e9ad94a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:10.895115 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:10.896565 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:10.910109 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311e4bd-0dc9-41e8-8c37-79ead6e0efb6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:10.923369 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:10.967624 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:10.969026 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:10.969312 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:10.969589 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] PATH_INFO: `/v3/projects/be9352d59f7b4ebebd94319448e70d6b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:10.970788 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9352d59f7b4ebebd94319448e70d6b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:10.972779 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:11.069348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9352d59f7b4ebebd94319448e70d6b', 'request_id': 'req-569c9478-6796-4277-8461-acb842bde4a3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:11.074849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9352d59f7b4ebebd94319448e70d6b', 'request_id': 'req-569c9478-6796-4277-8461-acb842bde4a3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:11.081039 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9352d59f7b4ebebd94319448e70d6b', 'request_id': 'req-569c9478-6796-4277-8461-acb842bde4a3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:11.173102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] The token cache is being invalidate because project be9352d59f7b4ebebd94319448e70d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:52:11.173319 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:11.173933 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-569c9478-6796-4277-8461-acb842bde4a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:52:11.175516 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1413/2833] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:52:10 2022] DELETE /identity/v3/projects/be9352d59f7b4ebebd94319448e70d6b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:11.181306 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ce04-d7e5-4827-b23e-22c264b3d582 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.181785 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ce04-d7e5-4827-b23e-22c264b3d582 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.181884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ce04-d7e5-4827-b23e-22c264b3d582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.199256 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d862ce04-d7e5-4827-b23e-22c264b3d582 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:11.200499 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d862ce04-d7e5-4827-b23e-22c264b3d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:11.257779 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1421/2834] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:11.266150 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5a837-bb5b-4db7-9f58-19ab04b29527 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.266439 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5a837-bb5b-4db7-9f58-19ab04b29527 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.266716 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5a837-bb5b-4db7-9f58-19ab04b29527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.286880 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-99e5a837-bb5b-4db7-9f58-19ab04b29527 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:11.288113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-99e5a837-bb5b-4db7-9f58-19ab04b29527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:11.295868 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1414/2835] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:11.300360 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862ce04-d7e5-4827-b23e-22c264b3d582 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:11.309868 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862ce04-d7e5-4827-b23e-22c264b3d582 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:11.314303 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:11.314937 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.315214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.315483 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.316234 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:52:11.316534 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:11.318119 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:11.329729 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1422/2836] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:52:11.333696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5a837-bb5b-4db7-9f58-19ab04b29527 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:11.342614 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5a837-bb5b-4db7-9f58-19ab04b29527 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:11.347677 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe06a4-8627-4517-8779-163f7984472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:11.348348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe06a4-8627-4517-8779-163f7984472c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.348626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe06a4-8627-4517-8779-163f7984472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.348896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe06a4-8627-4517-8779-163f7984472c admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.349567 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe06a4-8627-4517-8779-163f7984472c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:11.351546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe06a4-8627-4517-8779-163f7984472c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:11.482626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1415/2837] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:52:11 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:52:11.486468 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:11.496463 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e55972-2227-43f3-a1ec-fa98bfef37be admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:11.507833 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:11.552596 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3d794-9b9d-4d98-9ccd-30a84cafd615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:11.553270 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3d794-9b9d-4d98-9ccd-30a84cafd615 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.553549 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3d794-9b9d-4d98-9ccd-30a84cafd615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.553820 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3d794-9b9d-4d98-9ccd-30a84cafd615 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.554500 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3d794-9b9d-4d98-9ccd-30a84cafd615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:11.556527 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3d794-9b9d-4d98-9ccd-30a84cafd615 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:11.641195 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1423/2838] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:52:11 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:52:11.645498 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe06a4-8627-4517-8779-163f7984472c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:11.655646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe06a4-8627-4517-8779-163f7984472c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:11.660444 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1d833-cc37-4044-a4eb-70d10b0644f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:11.663294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d833-cc37-4044-a4eb-70d10b0644f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.663294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d833-cc37-4044-a4eb-70d10b0644f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.663294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d833-cc37-4044-a4eb-70d10b0644f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.663294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1d833-cc37-4044-a4eb-70d10b0644f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:11.664047 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1d833-cc37-4044-a4eb-70d10b0644f5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:11.674268 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1416/2839] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:11.678072 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3d794-9b9d-4d98-9ccd-30a84cafd615 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:11.688717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3d794-9b9d-4d98-9ccd-30a84cafd615 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:11.693442 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192ab7a-8b3a-42d3-902a-a3146ec14af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:11.694088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192ab7a-8b3a-42d3-902a-a3146ec14af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.694371 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192ab7a-8b3a-42d3-902a-a3146ec14af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.694649 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192ab7a-8b3a-42d3-902a-a3146ec14af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.695370 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192ab7a-8b3a-42d3-902a-a3146ec14af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:11.696991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192ab7a-8b3a-42d3-902a-a3146ec14af2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:11.707430 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1424/2840] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:11.711505 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1d833-cc37-4044-a4eb-70d10b0644f5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:11.721441 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1d833-cc37-4044-a4eb-70d10b0644f5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:11.726040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:11.726908 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.727186 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.727458 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] PATH_INFO: `/v3/projects/26d2a26394184388ad17fd887c90c768/users/66774a65beab4e6090994b261141eecc/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.743193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d2a26394184388ad17fd887c90c768, user_id=66774a65beab4e6090994b261141eecc, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:11.745855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:11.841430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1417/2841] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:52:11 2022] PUT /identity/v3/projects/26d2a26394184388ad17fd887c90c768/users/66774a65beab4e6090994b261141eecc/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:11.846435 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb0e5-d946-49dc-9c64-2f66eb16ada7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.846794 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb0e5-d946-49dc-9c64-2f66eb16ada7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.847082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb0e5-d946-49dc-9c64-2f66eb16ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:11.864358 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-d63eb0e5-d946-49dc-9c64-2f66eb16ada7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:11.865544 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d63eb0e5-d946-49dc-9c64-2f66eb16ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:11.922564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1425/2842] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:11.931951 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:11.933646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:11.978835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:11.990521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404d59-45bd-404b-be50-16a8b0bf2fd1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:11.994071 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad603-3a98-49c5-b8a3-e4a6eb9131a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:11.994708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad603-3a98-49c5-b8a3-e4a6eb9131a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:11.995065 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad603-3a98-49c5-b8a3-e4a6eb9131a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:11.995348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad603-3a98-49c5-b8a3-e4a6eb9131a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:12.006535 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cad603-3a98-49c5-b8a3-e4a6eb9131a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:12.008036 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cad603-3a98-49c5-b8a3-e4a6eb9131a7 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:12.017259 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1418/2843] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:17.098046 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f1a1-df2c-4d54-ae92-c712e8da5b71 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:17.101838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f1a1-df2c-4d54-ae92-c712e8da5b71 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:17.101838 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f1a1-df2c-4d54-ae92-c712e8da5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:17.126586 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bb26f1a1-df2c-4d54-ae92-c712e8da5b71 None None] MFA Rules not processed for user `66774a65beab4e6090994b261141eecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:17.127759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bb26f1a1-df2c-4d54-ae92-c712e8da5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:17.204095 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1426/2844] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:17.208685 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad603-3a98-49c5-b8a3-e4a6eb9131a7 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:17.219061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad603-3a98-49c5-b8a3-e4a6eb9131a7 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:17.223849 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89ec74-7600-44dd-99fa-7e19b4ce4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:17.224553 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89ec74-7600-44dd-99fa-7e19b4ce4399 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:17.224826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89ec74-7600-44dd-99fa-7e19b4ce4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:17.225104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89ec74-7600-44dd-99fa-7e19b4ce4399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:17.225813 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89ec74-7600-44dd-99fa-7e19b4ce4399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:17.227710 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89ec74-7600-44dd-99fa-7e19b4ce4399 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:17.306938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1419/2845] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:52:17 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:52:17.311049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26f1a1-df2c-4d54-ae92-c712e8da5b71 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:17.322642 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26f1a1-df2c-4d54-ae92-c712e8da5b71 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:17.343165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:17.381955 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752ed3a-8215-4e0d-a612-d1b1ac79f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:17.382645 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752ed3a-8215-4e0d-a612-d1b1ac79f6cd admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:17.382914 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752ed3a-8215-4e0d-a612-d1b1ac79f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:17.383192 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752ed3a-8215-4e0d-a612-d1b1ac79f6cd admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:17.384056 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752ed3a-8215-4e0d-a612-d1b1ac79f6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:17.389411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752ed3a-8215-4e0d-a612-d1b1ac79f6cd admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:17.470675 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1427/2846] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:52:17 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:52:17.474423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89ec74-7600-44dd-99fa-7e19b4ce4399 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:17.485647 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89ec74-7600-44dd-99fa-7e19b4ce4399 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:17.490612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b3478-80d4-416d-9c65-47774e18426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:17.491283 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b3478-80d4-416d-9c65-47774e18426c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:17.491561 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b3478-80d4-416d-9c65-47774e18426c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:17.491865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b3478-80d4-416d-9c65-47774e18426c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:17.492855 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b3478-80d4-416d-9c65-47774e18426c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:17.494437 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b3478-80d4-416d-9c65-47774e18426c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:17.506385 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1420/2847] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:17.510770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752ed3a-8215-4e0d-a612-d1b1ac79f6cd admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:17.521456 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752ed3a-8215-4e0d-a612-d1b1ac79f6cd admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:17.526420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb5741-de09-4034-9bac-46a29c8c721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:17.527324 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb5741-de09-4034-9bac-46a29c8c721f admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:17.527605 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb5741-de09-4034-9bac-46a29c8c721f admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:17.528069 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb5741-de09-4034-9bac-46a29c8c721f admin admin] PATH_INFO: `/v3/projects/62465b6c2aaa4c188e68f9e698668345/users/36401cf0dafd4bc1b5c10399f1a637c4/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:17.543974 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb5741-de09-4034-9bac-46a29c8c721f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62465b6c2aaa4c188e68f9e698668345, user_id=36401cf0dafd4bc1b5c10399f1a637c4, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:17.547160 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb5741-de09-4034-9bac-46a29c8c721f admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:17.654113 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1428/2848] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:52:17 2022] PUT /identity/v3/projects/62465b6c2aaa4c188e68f9e698668345/users/36401cf0dafd4bc1b5c10399f1a637c4/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:17.658590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b3478-80d4-416d-9c65-47774e18426c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:17.668869 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b3478-80d4-416d-9c65-47774e18426c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:17.724485 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784b6d-09a2-4043-9baf-93e6d7397e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:17.725147 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784b6d-09a2-4043-9baf-93e6d7397e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:17.725431 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784b6d-09a2-4043-9baf-93e6d7397e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:17.725708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784b6d-09a2-4043-9baf-93e6d7397e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:17.726429 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784b6d-09a2-4043-9baf-93e6d7397e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:17.728108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784b6d-09a2-4043-9baf-93e6d7397e77 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:17.741579 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1421/2849] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:52:17.742730 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb5741-de09-4034-9bac-46a29c8c721f admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:17.753035 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb5741-de09-4034-9bac-46a29c8c721f admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:17.757634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:17.758497 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:17.758784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:17.759063 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] PATH_INFO: `/v3/projects/62465b6c2aaa4c188e68f9e698668345/users/36401cf0dafd4bc1b5c10399f1a637c4/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:17.761090 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62465b6c2aaa4c188e68f9e698668345, user_id=36401cf0dafd4bc1b5c10399f1a637c4, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:17.763699 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:17.774185 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1429/2850] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:52:17 2022] PUT /identity/v3/projects/62465b6c2aaa4c188e68f9e698668345/users/36401cf0dafd4bc1b5c10399f1a637c4/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:52:23.121138 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03340-0056-4fcc-a498-3dfedf54e4e1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:23.121886 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03340-0056-4fcc-a498-3dfedf54e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:23.122402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03340-0056-4fcc-a498-3dfedf54e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:23.167203 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d6e03340-0056-4fcc-a498-3dfedf54e4e1 None None] MFA Rules not processed for user `36401cf0dafd4bc1b5c10399f1a637c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:23.168454 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d6e03340-0056-4fcc-a498-3dfedf54e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:23.257569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1422/2851] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:23.265619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:23.267584 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:23.330088 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a1910-44c8-40ee-a31f-af7da90cf9e1 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:23.333753 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17d6317775c343eaa9397254074647f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:23.334406 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:23.334694 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:23.334970 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:23.393936 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:23.395386 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:23.404930 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1430/2852] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:23.623221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7e67-2c3c-4d87-ba6a-4939b8ba6758 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:23.623546 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7e67-2c3c-4d87-ba6a-4939b8ba6758 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:23.623820 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7e67-2c3c-4d87-ba6a-4939b8ba6758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:23.642258 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-101e7e67-2c3c-4d87-ba6a-4939b8ba6758 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:23.643887 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-101e7e67-2c3c-4d87-ba6a-4939b8ba6758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:23.678239 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:23.704795 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1423/2853] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:52:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:23.863928 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:23.865342 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:23.900480 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:23.937236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a8534-c79a-4d93-9f92-d1c9081291f8 service glance] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:23.942407 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:23.943067 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:23.943349 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:23.943689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:23.952849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:23.954975 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:23.964078 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1431/2854] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:52:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:52:33.796000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:33.962165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=18 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:34.273102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3690f-b4f3-4985-82d3-a0c02e1fb09d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:34.273393 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3690f-b4f3-4985-82d3-a0c02e1fb09d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:34.273676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3690f-b4f3-4985-82d3-a0c02e1fb09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:34.290927 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b9b3690f-b4f3-4985-82d3-a0c02e1fb09d None None] MFA Rules not processed for user `66774a65beab4e6090994b261141eecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:34.292241 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9b3690f-b4f3-4985-82d3-a0c02e1fb09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:34.299131 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1424/2855] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:52:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:34.801589 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:34.802966 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:34.858362 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b39a7-87e3-4ce6-a1ac-c8dce3f33de0 service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:34.862529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767d476-acfc-4614-8e39-b4b14a71fa6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:34.863163 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767d476-acfc-4614-8e39-b4b14a71fa6d service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:34.863444 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767d476-acfc-4614-8e39-b4b14a71fa6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:34.863717 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767d476-acfc-4614-8e39-b4b14a71fa6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:34.865471 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-3767d476-acfc-4614-8e39-b4b14a71fa6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:34.874610 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767d476-acfc-4614-8e39-b4b14a71fa6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:34.876041 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767d476-acfc-4614-8e39-b4b14a71fa6d service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:34.883784 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1432/2856] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:35.299997 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3690f-b4f3-4985-82d3-a0c02e1fb09d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:35.301514 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9b3690f-b4f3-4985-82d3-a0c02e1fb09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:35.371804 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3690f-b4f3-4985-82d3-a0c02e1fb09d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:35.376822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:35.377464 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:35.377749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:35.378027 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:35.379790 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:35.391443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:35.393035 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:35.403043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1425/2857] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:38.141612 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4381a3-3976-41a6-9d15-1a8b205969a3 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:38.142096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4381a3-3976-41a6-9d15-1a8b205969a3 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:38.142215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4381a3-3976-41a6-9d15-1a8b205969a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:38.160455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-6f4381a3-3976-41a6-9d15-1a8b205969a3 None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:52:38.161683 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f4381a3-3976-41a6-9d15-1a8b205969a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:38.168907 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1433/2858] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jun 15 00:52:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:52:38.182471 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:38.193569 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f7ffe-988f-44b4-81c4-fd28bdcc4596 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:38.198449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f852138-cb3e-4b7e-983d-e290c16ef9fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:38.199072 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f852138-cb3e-4b7e-983d-e290c16ef9fb service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:38.199354 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f852138-cb3e-4b7e-983d-e290c16ef9fb service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:38.199626 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f852138-cb3e-4b7e-983d-e290c16ef9fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:38.208845 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f852138-cb3e-4b7e-983d-e290c16ef9fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:38.210724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f852138-cb3e-4b7e-983d-e290c16ef9fb service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:38.220313 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1426/2859] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:52:47.245760 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4381a3-3976-41a6-9d15-1a8b205969a3 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:47.248214 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-6f4381a3-3976-41a6-9d15-1a8b205969a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:47.384890 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4381a3-3976-41a6-9d15-1a8b205969a3 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:47.390446 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:47.391104 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:47.391413 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:47.391692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:47.393556 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:47.406554 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:47.408215 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:47.418627 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1434/2860] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:48.216333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=41 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:52:51.632608 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f852138-cb3e-4b7e-983d-e290c16ef9fb service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:52:51.678080 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f852138-cb3e-4b7e-983d-e290c16ef9fb service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:52:51.683386 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:52:51.684002 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:52:51.684294 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:52:51.684610 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:52:51.686414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:52:51.700423 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:52:51.702113 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:52:51.714503 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1427/2861] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:52:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:52:57.414105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=85 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:01.709208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=20 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:04.809445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:53:04.829071 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43258-3685-4232-9150-d67068b07330 service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:53:04.832794 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:53:04.833434 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:53:04.833748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:53:04.834027 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:53:04.842964 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:53:04.844479 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:53:04.853849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1435/2862] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:53:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:53:06.886236 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:53:06.887676 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:53:06.901532 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3aced-54d7-4a1b-8036-7fc6ab05322b service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:53:06.912724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1e914-f36a-4bdf-bdbb-a701df982d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:53:06.912724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e914-f36a-4bdf-bdbb-a701df982d8d service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:53:06.912724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e914-f36a-4bdf-bdbb-a701df982d8d service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:53:06.912724 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1e914-f36a-4bdf-bdbb-a701df982d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:53:06.913179 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-36d1e914-f36a-4bdf-bdbb-a701df982d8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:53:06.923346 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1e914-f36a-4bdf-bdbb-a701df982d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:53:06.924944 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1e914-f36a-4bdf-bdbb-a701df982d8d service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:53:06.935660 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1428/2863] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:53:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:53:14.849701 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=10 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:53:16.930888 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:26.171236 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:26.172529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:26.211335 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2ded4-c42b-475a-98d6-96840ce54a76 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:26.216328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:26.216972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:26.217253 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:26.217638 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:26.219420 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:26.231378 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:26.233044 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:26.243738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1436/2864] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:54:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:54:35.359192 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf28925-c391-4ad9-a395-c56d320e58ea None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:35.359682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf28925-c391-4ad9-a395-c56d320e58ea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:35.359785 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf28925-c391-4ad9-a395-c56d320e58ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:35.417276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bbf28925-c391-4ad9-a395-c56d320e58ea None None] MFA Rules not processed for user `21cd048d475f481393fd7749e4335c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:54:35.418457 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bbf28925-c391-4ad9-a395-c56d320e58ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:35.441738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1429/2865] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jun 15 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:54:35.481166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:35.501834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53167f9d-2720-4b02-86d1-4d70c74fa7a6 service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:35.506692 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20371f-37b3-4d57-ad2e-580aa64216ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7835f273e70a411fa7f8ee57395861f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:35.507311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20371f-37b3-4d57-ad2e-580aa64216ef service swift] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:35.507591 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20371f-37b3-4d57-ad2e-580aa64216ef service swift] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:35.507863 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20371f-37b3-4d57-ad2e-580aa64216ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:35.515634 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20371f-37b3-4d57-ad2e-580aa64216ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:35.517619 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20371f-37b3-4d57-ad2e-580aa64216ef service swift] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:35.526030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1437/2866] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jun 15 00:54:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:54:39.712155 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf28925-c391-4ad9-a395-c56d320e58ea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:39.730720 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf28925-c391-4ad9-a395-c56d320e58ea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:39.736434 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:39.737327 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:39.737612 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:39.737885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:39.740110 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:39.752544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:39.754143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:39.764636 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1430/2867] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:54:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:54:43.353005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20371f-37b3-4d57-ad2e-580aa64216ef service swift] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:43.432432 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20371f-37b3-4d57-ad2e-580aa64216ef service swift] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:43.436853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:43.437702 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:43.437981 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:43.438250 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] PATH_INFO: `/v3/users/66774a65beab4e6090994b261141eecc` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:43.440059 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66774a65beab4e6090994b261141eecc)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:43.441953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:43.617081 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66774a65beab4e6090994b261141eecc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:43.623997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66774a65beab4e6090994b261141eecc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:43.689445 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66774a65beab4e6090994b261141eecc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:43.690097 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66774a65beab4e6090994b261141eecc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:43.701990 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66774a65beab4e6090994b261141eecc'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:43.707989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1438/2868] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:54:43 2022] DELETE /identity/v3/users/66774a65beab4e6090994b261141eecc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:54:43.932940 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:43.943541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af687b-71a1-4e10-8fa4-cb36d554688a service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:44.000053 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:44.000915 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:44.001196 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:44.001472 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] PATH_INFO: `/v3/projects/26d2a26394184388ad17fd887c90c768` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:44.002635 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d2a26394184388ad17fd887c90c768)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:44.004572 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:44.085173 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d2a26394184388ad17fd887c90c768', 'request_id': 'req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.090580 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d2a26394184388ad17fd887c90c768', 'request_id': 'req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.099209 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d2a26394184388ad17fd887c90c768', 'request_id': 'req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.171161 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] The token cache is being invalidate because project 26d2a26394184388ad17fd887c90c768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:54:44.171449 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.172099 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.173728 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1431/2869] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:54:43 2022] DELETE /identity/v3/projects/26d2a26394184388ad17fd887c90c768 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:54:44.177901 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:44.179277 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:44.192847 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e0724-d635-467b-b131-8c1721f7f43d admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:44.196773 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:44.255107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:44.257514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:44.257514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:44.257514 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] PATH_INFO: `/v3/users/36401cf0dafd4bc1b5c10399f1a637c4` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:44.257811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36401cf0dafd4bc1b5c10399f1a637c4)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:44.259686 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:44.402118 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36401cf0dafd4bc1b5c10399f1a637c4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.409481 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36401cf0dafd4bc1b5c10399f1a637c4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.451241 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36401cf0dafd4bc1b5c10399f1a637c4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.451816 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36401cf0dafd4bc1b5c10399f1a637c4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.464149 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-00d5a2a6-8620-4f55-857e-1a474207f34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36401cf0dafd4bc1b5c10399f1a637c4'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.470144 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1439/2870] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 00:54:44 2022] DELETE /identity/v3/users/36401cf0dafd4bc1b5c10399f1a637c4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:54:44.704819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:44.704819 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:44.719368 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff72229-3a5c-4a1b-ae4d-110cb83c0c0b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:44.727451 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:44.780252 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:44.781097 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:44.781474 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:44.781754 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] PATH_INFO: `/v3/projects/62465b6c2aaa4c188e68f9e698668345` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:44.782942 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62465b6c2aaa4c188e68f9e698668345)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:44.785005 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:44.903119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62465b6c2aaa4c188e68f9e698668345', 'request_id': 'req-de2926fc-09b7-482a-a98a-b1ad0dd18547'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.908420 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62465b6c2aaa4c188e68f9e698668345', 'request_id': 'req-de2926fc-09b7-482a-a98a-b1ad0dd18547'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.914422 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62465b6c2aaa4c188e68f9e698668345', 'request_id': 'req-de2926fc-09b7-482a-a98a-b1ad0dd18547'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.988325 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] The token cache is being invalidate because project 62465b6c2aaa4c188e68f9e698668345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:54:44.988956 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.989134 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-de2926fc-09b7-482a-a98a-b1ad0dd18547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:54:44.990683 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1432/2871] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 00:54:44 2022] DELETE /identity/v3/projects/62465b6c2aaa4c188e68f9e698668345 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:54:44.995530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96635a81-1d09-492e-9c59-d3a1e1e38ff7 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:44.995822 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96635a81-1d09-492e-9c59-d3a1e1e38ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:44.996233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96635a81-1d09-492e-9c59-d3a1e1e38ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.050906 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-96635a81-1d09-492e-9c59-d3a1e1e38ff7 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:54:45.052116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-96635a81-1d09-492e-9c59-d3a1e1e38ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:45.096567 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:45.107346 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1440/2872] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:54:45.115541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e658-0e2a-48be-adcc-50f499859064 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.115826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e658-0e2a-48be-adcc-50f499859064 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.116132 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3e658-0e2a-48be-adcc-50f499859064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.134547 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fbb3e658-0e2a-48be-adcc-50f499859064 None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:54:45.135729 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fbb3e658-0e2a-48be-adcc-50f499859064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:45.143530 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1433/2873] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:54:45.147849 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96635a81-1d09-492e-9c59-d3a1e1e38ff7 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:45.157770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96635a81-1d09-492e-9c59-d3a1e1e38ff7 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:45.162263 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:45.162899 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.163177 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.163449 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] PATH_INFO: `/v3/domains` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.164232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80498) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:54:45.164539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:45.166159 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:45.178410 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1441/2874] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jun 15 00:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:54:45.182430 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3e658-0e2a-48be-adcc-50f499859064 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:45.191826 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3e658-0e2a-48be-adcc-50f499859064 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:45.196665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47fece-16c9-46da-9bc9-abcc9dbfc677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:45.197309 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47fece-16c9-46da-9bc9-abcc9dbfc677 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.197590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47fece-16c9-46da-9bc9-abcc9dbfc677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.197865 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47fece-16c9-46da-9bc9-abcc9dbfc677 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.198592 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47fece-16c9-46da-9bc9-abcc9dbfc677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:45.200521 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47fece-16c9-46da-9bc9-abcc9dbfc677 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:45.309797 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1434/2875] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:54:45 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:54:45.314006 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:45.323706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfad5a-66d7-4b4f-86e4-ac89bcb6b09b admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:45.380184 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201698df-26e2-4c15-85f8-de15f41ff391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:45.380848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201698df-26e2-4c15-85f8-de15f41ff391 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.381133 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201698df-26e2-4c15-85f8-de15f41ff391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.381412 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201698df-26e2-4c15-85f8-de15f41ff391 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.382092 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201698df-26e2-4c15-85f8-de15f41ff391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:45.384170 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201698df-26e2-4c15-85f8-de15f41ff391 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:45.466564 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1442/2876] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:54:45 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:54:45.471008 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47fece-16c9-46da-9bc9-abcc9dbfc677 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:45.481145 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47fece-16c9-46da-9bc9-abcc9dbfc677 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:45.486301 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad3dff-a46d-4ecc-bf0f-b3974d860862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:45.486949 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3dff-a46d-4ecc-bf0f-b3974d860862 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.487227 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3dff-a46d-4ecc-bf0f-b3974d860862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.487499 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3dff-a46d-4ecc-bf0f-b3974d860862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.488254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad3dff-a46d-4ecc-bf0f-b3974d860862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:45.489822 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad3dff-a46d-4ecc-bf0f-b3974d860862 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:45.499950 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1435/2877] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:54:45.503599 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201698df-26e2-4c15-85f8-de15f41ff391 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:45.513491 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201698df-26e2-4c15-85f8-de15f41ff391 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:45.518037 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ab31b-0d9a-4350-a583-16fac69be2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:45.518673 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ab31b-0d9a-4350-a583-16fac69be2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.518957 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ab31b-0d9a-4350-a583-16fac69be2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.519233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ab31b-0d9a-4350-a583-16fac69be2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.520244 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ab31b-0d9a-4350-a583-16fac69be2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:45.521825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ab31b-0d9a-4350-a583-16fac69be2cb admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:45.531525 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1443/2878] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:54:45.535829 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad3dff-a46d-4ecc-bf0f-b3974d860862 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:45.545348 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad3dff-a46d-4ecc-bf0f-b3974d860862 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:45.550545 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:45.551392 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.551670 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.551973 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] PATH_INFO: `/v3/projects/108d230bcfcb4f718b59e3bbb875f641/users/272ca1a24cb4415db3abe93e7964b61c/roles/a7a423c4a93a47adb277eb4b35903b4c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.565964 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=108d230bcfcb4f718b59e3bbb875f641, user_id=272ca1a24cb4415db3abe93e7964b61c, role_id=a7a423c4a93a47adb277eb4b35903b4c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:45.568568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:45.666563 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1436/2879] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:54:45 2022] PUT /identity/v3/projects/108d230bcfcb4f718b59e3bbb875f641/users/272ca1a24cb4415db3abe93e7964b61c/roles/a7a423c4a93a47adb277eb4b35903b4c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:54:45.671644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da0d57-8d4c-415c-954f-9dcb9f4ecf7d None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.671965 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da0d57-8d4c-415c-954f-9dcb9f4ecf7d None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.672246 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da0d57-8d4c-415c-954f-9dcb9f4ecf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.689656 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-a9da0d57-8d4c-415c-954f-9dcb9f4ecf7d None None] MFA Rules not processed for user `c25537e8f9b64e58ba6db076b2ad8db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:54:45.690891 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-a9da0d57-8d4c-415c-954f-9dcb9f4ecf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:45.750175 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1444/2880] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:54:45.759681 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:45.761443 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:45.803193 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:45.828291 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449925c-7ed7-43e4-8ca1-ed6cd258b7ab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:45.833048 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c7eac-bd44-483d-b688-b26aeb5c6ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:45.833680 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7eac-bd44-483d-b688-b26aeb5c6ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:45.833960 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7eac-bd44-483d-b688-b26aeb5c6ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:45.834234 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c7eac-bd44-483d-b688-b26aeb5c6ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:45.842885 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c7eac-bd44-483d-b688-b26aeb5c6ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:45.844336 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c7eac-bd44-483d-b688-b26aeb5c6ebf service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:45.855111 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1437/2881] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:54:50.806457 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed28191-ac4f-442e-a0d9-facd1cacdeb8 None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:50.807042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed28191-ac4f-442e-a0d9-facd1cacdeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:50.807042 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed28191-ac4f-442e-a0d9-facd1cacdeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:50.840415 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-bed28191-ac4f-442e-a0d9-facd1cacdeb8 None None] MFA Rules not processed for user `272ca1a24cb4415db3abe93e7964b61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:54:50.841655 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-bed28191-ac4f-442e-a0d9-facd1cacdeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:50.901223 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:50.920848 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1445/2882] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:54:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:54:50.926655 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c7eac-bd44-483d-b688-b26aeb5c6ebf service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:50.937531 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c7eac-bd44-483d-b688-b26aeb5c6ebf service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:50.943544 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfede5-433a-4c27-93e8-0abb62e6b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:50.944251 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfede5-433a-4c27-93e8-0abb62e6b0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:50.944528 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfede5-433a-4c27-93e8-0abb62e6b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:50.944800 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfede5-433a-4c27-93e8-0abb62e6b0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:50.945496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfede5-433a-4c27-93e8-0abb62e6b0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:50.947477 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfede5-433a-4c27-93e8-0abb62e6b0e6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:51.069033 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1438/2883] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jun 15 00:54:50 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:54:51.070267 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed28191-ac4f-442e-a0d9-facd1cacdeb8 None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:51.081748 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed28191-ac4f-442e-a0d9-facd1cacdeb8 None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:51.141232 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeadfe-ee30-4e0b-a607-61eca13843a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:51.141952 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeadfe-ee30-4e0b-a607-61eca13843a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:51.142231 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeadfe-ee30-4e0b-a607-61eca13843a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:51.142502 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeadfe-ee30-4e0b-a607-61eca13843a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:51.143187 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeadfe-ee30-4e0b-a607-61eca13843a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:51.145471 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeadfe-ee30-4e0b-a607-61eca13843a6 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:51.249989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1446/2884] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jun 15 00:54:51 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:54:51.253993 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfede5-433a-4c27-93e8-0abb62e6b0e6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:51.265719 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfede5-433a-4c27-93e8-0abb62e6b0e6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:51.270651 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034d9c9-ad1e-4770-b395-901adccd86cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:51.271321 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034d9c9-ad1e-4770-b395-901adccd86cf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:51.271619 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034d9c9-ad1e-4770-b395-901adccd86cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:51.271896 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034d9c9-ad1e-4770-b395-901adccd86cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:51.272662 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034d9c9-ad1e-4770-b395-901adccd86cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:51.275276 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034d9c9-ad1e-4770-b395-901adccd86cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:51.286738 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1439/2885] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:54:51.290989 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeadfe-ee30-4e0b-a607-61eca13843a6 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:51.301925 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeadfe-ee30-4e0b-a607-61eca13843a6 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:51.306576 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020181a-45e5-4334-aac7-0c8e01622d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:51.307465 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020181a-45e5-4334-aac7-0c8e01622d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:51.307804 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020181a-45e5-4334-aac7-0c8e01622d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:51.308151 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020181a-45e5-4334-aac7-0c8e01622d84 admin admin] PATH_INFO: `/v3/projects/024fe059be404508b325f18dc05f296c/users/03574007555b4de49e94f7472cb59102/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:51.322762 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020181a-45e5-4334-aac7-0c8e01622d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024fe059be404508b325f18dc05f296c, user_id=03574007555b4de49e94f7472cb59102, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:51.325411 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020181a-45e5-4334-aac7-0c8e01622d84 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:51.400572 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1447/2886] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:54:51 2022] PUT /identity/v3/projects/024fe059be404508b325f18dc05f296c/users/03574007555b4de49e94f7472cb59102/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:54:51.404501 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034d9c9-ad1e-4770-b395-901adccd86cf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:51.414825 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034d9c9-ad1e-4770-b395-901adccd86cf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:51.469151 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedebbb9-9c2b-43f5-95ad-b04841816a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:51.470315 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedebbb9-9c2b-43f5-95ad-b04841816a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:51.470596 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedebbb9-9c2b-43f5-95ad-b04841816a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:51.470872 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedebbb9-9c2b-43f5-95ad-b04841816a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:51.471585 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedebbb9-9c2b-43f5-95ad-b04841816a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:51.473208 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedebbb9-9c2b-43f5-95ad-b04841816a4e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:51.482866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1440/2887] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jun 15 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:54:51.487953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020181a-45e5-4334-aac7-0c8e01622d84 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:51.499147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020181a-45e5-4334-aac7-0c8e01622d84 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:51.503799 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:51.504705 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:51.504985 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:51.505260 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] PATH_INFO: `/v3/projects/024fe059be404508b325f18dc05f296c/users/03574007555b4de49e94f7472cb59102/roles/5e07e6070ab24fe5b212f357d6ba3775` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:51.507233 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024fe059be404508b325f18dc05f296c, user_id=03574007555b4de49e94f7472cb59102, role_id=5e07e6070ab24fe5b212f357d6ba3775)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:51.509923 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:51.520493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1448/2888] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jun 15 00:54:51 2022] PUT /identity/v3/projects/024fe059be404508b325f18dc05f296c/users/03574007555b4de49e94f7472cb59102/roles/5e07e6070ab24fe5b212f357d6ba3775 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:54:56.792298 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a886e-a130-42a0-a029-6d673ae68974 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:56.792811 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a886e-a130-42a0-a029-6d673ae68974 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:56.792938 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a886e-a130-42a0-a029-6d673ae68974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:56.821634 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dd6a886e-a130-42a0-a029-6d673ae68974 None None] MFA Rules not processed for user `03574007555b4de49e94f7472cb59102`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:54:56.822765 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd6a886e-a130-42a0-a029-6d673ae68974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:56.893172 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1441/2889] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:54:56.909840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:56.912329 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:57.020060 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a812bec-5143-49d7-a3b1-f974db6c57f2 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:57.025712 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:57.026388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:57.026676 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:57.026953 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:57.045425 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:57.098116 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:57.099815 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:57.113720 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1449/2890] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:54:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:55:06.890077 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:07.308997 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=18 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:17.328309 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b320d-901e-4015-814e-9a56b0748146 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:55:17.328791 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b320d-901e-4015-814e-9a56b0748146 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:55:17.328910 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b320d-901e-4015-814e-9a56b0748146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:55:17.345846 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b77b320d-901e-4015-814e-9a56b0748146 None None] MFA Rules not processed for user `272ca1a24cb4415db3abe93e7964b61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:55:17.347018 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b77b320d-901e-4015-814e-9a56b0748146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:55:17.353744 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1442/2891] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:55:20.584178 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:55:20.585720 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:55:20.646212 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24716e0-2036-4d4f-9208-ac25025f6c2f service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:55:20.649992 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:55:20.650811 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:55:20.651105 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:55:20.652738 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:55:20.654629 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:55:20.669210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:55:20.670662 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:55:20.682884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1450/2892] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:55:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:55:27.340695 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:30.003119 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b320d-901e-4015-814e-9a56b0748146 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:55:30.012540 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b320d-901e-4015-814e-9a56b0748146 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:55:30.016749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:55:30.017401 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:55:30.017691 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:55:30.017969 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:55:30.019769 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:55:30.034040 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:55:30.035486 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:55:30.046221 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1443/2893] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:55:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:55:30.677734 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=26 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:37.356207 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:55:37.364837 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f273f-e5c4-4545-b2a9-0d51189324ef service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:55:37.368429 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6e8f0-089a-47a7-95de-41a461ecbb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:55:37.369058 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6e8f0-089a-47a7-95de-41a461ecbb0e service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:55:37.369340 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6e8f0-089a-47a7-95de-41a461ecbb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:55:37.369628 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6e8f0-089a-47a7-95de-41a461ecbb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:55:37.378644 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6e8f0-089a-47a7-95de-41a461ecbb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:55:37.380094 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6e8f0-089a-47a7-95de-41a461ecbb0e service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:55:37.389448 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1451/2894] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:55:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:55:40.041461 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:55:47.385320 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:56:34.819140 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:56:34.827622 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30864c-6c8c-4e48-bbfa-f345d69bcd71 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:56:34.831837 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:56:34.832491 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:56:34.832770 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:56:34.833043 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:56:34.834782 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:56:34.844551 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:56:34.845983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:56:34.853853 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1444/2895] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:56:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:56:44.850217 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:41.923797 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575fc6-6103-45e2-8c6b-e09b21757d1a None None] REQUEST_METHOD: `POST` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:57:41.924310 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575fc6-6103-45e2-8c6b-e09b21757d1a None None] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:57:41.924418 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8575fc6-6103-45e2-8c6b-e09b21757d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:57:41.941010 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.auth.core [None req-c8575fc6-6103-45e2-8c6b-e09b21757d1a None None] MFA Rules not processed for user `272ca1a24cb4415db3abe93e7964b61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80498) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:57:41.942186 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c8575fc6-6103-45e2-8c6b-e09b21757d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:57:41.948845 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1452/2896] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:57:42.246079 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:57:42.257496 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a004b-5770-4027-a887-034a0c99874a service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:57:42.261102 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:57:42.261734 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:57:42.262012 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:57:42.262286 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:57:42.264031 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:57:42.274857 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:57:42.276402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:57:42.284419 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1445/2897] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:57:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:57:43.239770 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8575fc6-6103-45e2-8c6b-e09b21757d1a None None] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:57:43.241157 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-c8575fc6-6103-45e2-8c6b-e09b21757d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:57:43.309986 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8575fc6-6103-45e2-8c6b-e09b21757d1a None None] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:57:43.314860 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:57:43.315493 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:57:43.315771 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:57:43.316082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:57:43.317831 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:57:43.329206 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:57:43.330759 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:57:43.340333 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1453/2898] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:57:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:57:52.280727 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:53.336210 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=35 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:57:56.928835 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:57:56.942641 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6410-23a2-49ba-a02e-bfd6319a89ad service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:57:56.948083 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fa6f0-0ab2-468d-bb12-b676b6dfd654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:57:56.948714 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fa6f0-0ab2-468d-bb12-b676b6dfd654 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:57:56.948992 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fa6f0-0ab2-468d-bb12-b676b6dfd654 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:57:56.949263 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fa6f0-0ab2-468d-bb12-b676b6dfd654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:57:56.951000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-df3fa6f0-0ab2-468d-bb12-b676b6dfd654 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:57:56.963791 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fa6f0-0ab2-468d-bb12-b676b6dfd654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:57:56.965473 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fa6f0-0ab2-468d-bb12-b676b6dfd654 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:57:56.976223 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1446/2899] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:57:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:58:06.971625 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:59:30.136896 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:59:30.138276 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:59:30.151938 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b3c1f-1bf9-482a-8fad-e95dba60959a service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:59:30.156931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:59:30.157557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:59:30.157840 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:59:30.158117 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:59:30.159807 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:59:30.170853 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:59:30.172447 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:59:30.182122 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1454/2900] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:59:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:59:40.177924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:59:48.754566 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec52e8-351a-4d1d-9f1d-27a3575318cf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:59:48.755004 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec52e8-351a-4d1d-9f1d-27a3575318cf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:59:48.755104 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec52e8-351a-4d1d-9f1d-27a3575318cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:59:48.772599 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6dec52e8-351a-4d1d-9f1d-27a3575318cf None None] MFA Rules not processed for user `272ca1a24cb4415db3abe93e7964b61c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:59:48.773816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6dec52e8-351a-4d1d-9f1d-27a3575318cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:59:48.781062 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1447/2901] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jun 15 00:59:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:59:54.647202 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:59:54.663551 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b91ae6-c47b-45e3-9bde-f51ebd96f4dc service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:59:54.671165 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:59:54.671827 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:59:54.672274 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:59:54.672557 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:59:54.674455 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:59:54.688273 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:59:54.689971 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:59:54.702124 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1455/2902] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:59:56.512000 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec52e8-351a-4d1d-9f1d-27a3575318cf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:59:56.525577 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec52e8-351a-4d1d-9f1d-27a3575318cf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:59:56.530875 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:59:56.531525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:59:56.531805 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:59:56.532107 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:59:56.539590 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:59:56.541190 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:59:56.550248 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1448/2903] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 00:59:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:00:04.696598 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=6 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:00:06.545832 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=9 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:01:40.825706 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:01:40.834991 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946d73-c47c-4901-8e7f-a3a5c69550ef service nova] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:01:40.838640 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d999-d365-42a5-87b6-83ffed91217f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:01:40.839259 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d999-d365-42a5-87b6-83ffed91217f service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:01:40.839541 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d999-d365-42a5-87b6-83ffed91217f service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:01:40.839818 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d999-d365-42a5-87b6-83ffed91217f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:01:40.847005 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d999-d365-42a5-87b6-83ffed91217f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:01:40.848485 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d999-d365-42a5-87b6-83ffed91217f service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:01:40.857096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1456/2904] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 01:01:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:01:50.190041 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:01:50.191541 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 01:01:50.208983 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b9b60-b388-4cea-a8f8-b9989f978862 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:01:50.214806 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad41d031778c4e8ebc8c176c3670f4b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:01:50.215500 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:01:50.215780 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:01:50.216085 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:01:50.217861 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 01:01:50.233219 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:01:50.235049 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:01:50.247298 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1449/2905] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 01:01:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:01:50.560530 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d999-d365-42a5-87b6-83ffed91217f service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:01:50.569606 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d999-d365-42a5-87b6-83ffed91217f service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:01:50.573255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df0388-3033-4dbb-9676-d12e6d6f72b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:01:50.573884 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0388-3033-4dbb-9676-d12e6d6f72b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:01:50.574166 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0388-3033-4dbb-9676-d12e6d6f72b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:01:50.574440 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0388-3033-4dbb-9676-d12e6d6f72b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:01:50.585049 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df0388-3033-4dbb-9676-d12e6d6f72b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:01:50.586476 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df0388-3033-4dbb-9676-d12e6d6f72b9 service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:01:50.598931 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1457/2906] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 01:01:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:01:51.772903 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:01:51.782463 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982bc6f-6e91-4e6c-9dc0-a17af194432f service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:01:51.786214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079b0ea-8fb2-4d76-a662-97c1ed7ae6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:01:51.786899 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b0ea-8fb2-4d76-a662-97c1ed7ae6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:01:51.787183 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b0ea-8fb2-4d76-a662-97c1ed7ae6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:01:51.787459 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b0ea-8fb2-4d76-a662-97c1ed7ae6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:01:51.798656 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079b0ea-8fb2-4d76-a662-97c1ed7ae6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:01:51.800108 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079b0ea-8fb2-4d76-a662-97c1ed7ae6d5 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:01:51.811703 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1450/2907] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 01:01:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:02:00.593082 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=12 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:02:01.806137 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=12 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:02:05.956146 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df0388-3033-4dbb-9676-d12e6d6f72b9 service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:02:05.965539 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df0388-3033-4dbb-9676-d12e6d6f72b9 service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:02:05.969218 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb155c-099e-4a36-8431-53a55dba863c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1eaffae68edd4031ac771310b7d645cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:02:05.969888 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb155c-099e-4a36-8431-53a55dba863c service neutron] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:02:05.970171 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb155c-099e-4a36-8431-53a55dba863c service neutron] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:02:05.970454 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb155c-099e-4a36-8431-53a55dba863c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:02:06.029328 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb155c-099e-4a36-8431-53a55dba863c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:02:06.030746 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb155c-099e-4a36-8431-53a55dba863c service neutron] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:02:06.040030 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1458/2908] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 01:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:02:09.526682 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079b0ea-8fb2-4d76-a662-97c1ed7ae6d5 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:02:09.538506 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079b0ea-8fb2-4d76-a662-97c1ed7ae6d5 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:02:09.545068 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:02:09.545749 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:02:09.546164 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:02:09.546450 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:02:09.548254 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 01:02:09.561066 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:02:09.562713 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:02:09.575061 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1451/2909] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 01:02:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:02:12.838657 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb155c-099e-4a36-8431-53a55dba863c service neutron] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:02:12.850416 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb155c-099e-4a36-8431-53a55dba863c service neutron] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:02:12.856096 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:02:12.856741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] REQUEST_METHOD: `GET` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:02:12.857021 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:02:12.857296 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:02:12.859051 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 01:02:12.871019 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:02:12.872741 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:02:12.886436 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1459/2910] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 01:02:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:02:12.984402 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:02:12.995866 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf88e7e-61b0-4779-8421-78cb1b1bb9bf service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:02:13.000568 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:02:13.001428 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:02:13.001708 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:02:13.001979 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] PATH_INFO: `/v3/users/272ca1a24cb4415db3abe93e7964b61c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:02:13.003143 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=272ca1a24cb4415db3abe93e7964b61c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:02:13.005106 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:02:13.161555 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272ca1a24cb4415db3abe93e7964b61c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.239513 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272ca1a24cb4415db3abe93e7964b61c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.251564 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272ca1a24cb4415db3abe93e7964b61c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.252226 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272ca1a24cb4415db3abe93e7964b61c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.259578 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272ca1a24cb4415db3abe93e7964b61c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.265557 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1452/2911] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 01:02:12 2022] DELETE /identity/v3/users/272ca1a24cb4415db3abe93e7964b61c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 01:02:13.503983 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:02:13.515834 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2c684-493e-4a01-bba5-6fca91d7fd1f service placement] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:02:13.572532 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:02:13.573381 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:02:13.573664 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:02:13.574065 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] PATH_INFO: `/v3/projects/108d230bcfcb4f718b59e3bbb875f641` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:02:13.575230 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=108d230bcfcb4f718b59e3bbb875f641)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:02:13.577147 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:02:13.692003 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108d230bcfcb4f718b59e3bbb875f641', 'request_id': 'req-236dfacd-dcda-4df0-b61f-8fe7d0947442'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.698148 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108d230bcfcb4f718b59e3bbb875f641', 'request_id': 'req-236dfacd-dcda-4df0-b61f-8fe7d0947442'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.704341 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108d230bcfcb4f718b59e3bbb875f641', 'request_id': 'req-236dfacd-dcda-4df0-b61f-8fe7d0947442'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.798216 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] The token cache is being invalidate because project 108d230bcfcb4f718b59e3bbb875f641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 01:02:13.798510 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.799135 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:13.800789 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1460/2912] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 01:02:13 2022] DELETE /identity/v3/projects/108d230bcfcb4f718b59e3bbb875f641 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 01:02:13.804776 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:02:13.806816 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 01:02:13.819646 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f04f-a151-4f2c-a718-987ff078e786 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:02:13.874333 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:02:13.875199 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:02:13.875484 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:02:13.875762 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] PATH_INFO: `/v3/users/03574007555b4de49e94f7472cb59102` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:02:13.876962 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03574007555b4de49e94f7472cb59102)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:02:13.878850 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:02:14.028529 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03574007555b4de49e94f7472cb59102'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.106550 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03574007555b4de49e94f7472cb59102'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.112178 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:02:14.119525 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03574007555b4de49e94f7472cb59102'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.120222 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03574007555b4de49e94f7472cb59102'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.127037 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03574007555b4de49e94f7472cb59102'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.132894 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1453/2913] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jun 15 01:02:13 2022] DELETE /identity/v3/users/03574007555b4de49e94f7472cb59102 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 01:02:14.364855 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] Authenticating user token {{(pid=80498) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:02:14.366388 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.fernet_utils [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80498) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 01:02:14.382190 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dfacd-dcda-4df0-b61f-8fe7d0947442 admin admin] Validating token access rules against request {{(pid=80498) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:02:14.390311 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:02:14.440107 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c25537e8f9b64e58ba6db076b2ad8db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef6352e5d076419cbaba12161ca4f129', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80498) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:02:14.440972 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:02:14.441255 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:02:14.441529 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] PATH_INFO: `/v3/projects/024fe059be404508b325f18dc05f296c` {{(pid=80498) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:02:14.442714 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024fe059be404508b325f18dc05f296c)` {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:02:14.444689 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] RBAC: Authorization granted {{(pid=80498) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:02:14.553825 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024fe059be404508b325f18dc05f296c', 'request_id': 'req-4b1d54f9-78e5-4e52-a754-e549933c7e70'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.559688 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024fe059be404508b325f18dc05f296c', 'request_id': 'req-4b1d54f9-78e5-4e52-a754-e549933c7e70'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.565924 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024fe059be404508b325f18dc05f296c', 'request_id': 'req-4b1d54f9-78e5-4e52-a754-e549933c7e70'} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.637782 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] The token cache is being invalidate because project 024fe059be404508b325f18dc05f296c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80498) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 01:02:14.638033 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.638650 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG keystone.notifications [None req-4b1d54f9-78e5-4e52-a754-e549933c7e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80498) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 01:02:14.640211 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: [pid: 80498|app: 0|req: 1461/2914] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jun 15 01:02:14 2022] DELETE /identity/v3/projects/024fe059be404508b325f18dc05f296c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 01:02:24.277799 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=9,keystone:DELETE=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:02:24.634138 dv-cinder-845178-5-iscsi devstack@keystone.service[80498]: DEBUG dbcounter [-] [80498] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 01:04:34.385467 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 01:04:34.386848 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 01:04:34.524600 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d3f8c-eb51-4341-89b5-eb88de4da78a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 01:04:34.582025 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c34c8d-626e-409c-8a3d-264b0c862c7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6cc8de6532145799454b27e742259d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a09d802211fa462d87de5e87cf6dbb90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 01:04:34.582665 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c34c8d-626e-409c-8a3d-264b0c862c7e service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 01:04:34.582941 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c34c8d-626e-409c-8a3d-264b0c862c7e service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 01:04:34.583214 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c34c8d-626e-409c-8a3d-264b0c862c7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 01:04:34.584957 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b8c34c8d-626e-409c-8a3d-264b0c862c7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 01:04:34.595699 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c34c8d-626e-409c-8a3d-264b0c862c7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 01:04:34.597292 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c34c8d-626e-409c-8a3d-264b0c862c7e service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 01:04:34.607414 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1454/2915] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jun 15 01:04:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 01:04:44.602696 dv-cinder-845178-5-iscsi devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}